Product
Deepinflow
A large-scale online inference framework open-sourced by DeepSeek, integrating high-performance operators, parallelism strategies, speculative decoding, and asynchronous scheduling, with the aim of reducing the deployment cost of large-model inference.
Timeline (last 90 days)
Oct 23
Deepinflow has open-sourced components such as high-performance operators, parallel strategies, speculative decoding, and asynchronous scheduling.
Unverified50%