DeepSeek V3
A large-scale Mixture-of-Experts (MoE) language model released by DeepSeek, introducing innovations in MoE engineering challenges such as load balancing. The model employs mechanisms including auxiliary-loss-free load balancing to improve training efficiency.
Core Facts
According to official disclosure, DeepSeek's training cost was only approximately $6 million.
DeepSeek R1 does not support Function Calling by default, whereas DeepSeek V3 supports Function Calling.
DeepSeek introduced MTP technology as early as version V3.
Timeline (last 90 days)
Some Claude Code features are tuned for Anthropic model characteristics, and after switching to other models the stability of tool calls and long-context performance may differ.
In FP8 mixed-precision training, V3 uses FP8 computation for most matrix multiplications and retains higher precision for precision-sensitive steps, theoretically doubling compute throughput and halving memory usage compared with BF16.
DeepSeek V3, released on December 26, 2024, has 671 billion total parameters and 37 billion activated parameters, uses FP8 training, reports a compute cost of $5.576 million in its paper, and matches GPT-4o in performance.
Nexus-CLI supports DeepSeek R1/V3 as backend inference engines while being compatible with Claude Code's interaction protocol and Ollama's model management interface.
Nexus-CLI is a CLI tool implemented in pure Go, used to bridge the DeepSeek R1/V3 models with the Claude Code and Ollama ecosystems.
On the prefill sizes of DeepSeek V2 and V3, FlyDSL Flex Attention achieved close to a 2x improvement.
The Mixture of Experts (MoE) architecture is the core design adopted by a new generation of large models such as DeepSeek V3, where a routing mechanism dynamically selects a small number of experts to activate each time an input is processed.
The decode unit of DeepSeek V3 uses 144-card EP, amortizing the weight load overhead across large batches and freeing up GPU memory to increase batch size.
Most of Sebastian's course code runs on a Mac mini; the goal of the course is to demonstrate the principles of reasoning techniques using small models, rather than to replicate ultra-large models such as DeepSeek V3/V4.
Gemini, Claude, and DeepSeek V3 all support Function Calling.
5 more timeline events
All Facts (20)
According to official disclosure, DeepSeek's training cost was only approximately $6 million.
80%VerifiedDeepSeek R1 does not support Function Calling by default, whereas DeepSeek V3 supports Function Calling.
80%VerifiedDeepSeek introduced MTP technology as early as version V3.
75%VerifiedQwen3.5's parameter activation rate is 4.3%, while DeepSeek V3's 671B model has an activation rate of 5.5%.
65%VerifiedDeepSeek has undergone iterative model updates from V2 to V3 to R1, with both model capabilities and interaction methods changing rapidly.
65%UnverifiedDeepSeek V3版本参数规模达到671B MoE架构
90%UnverifiedDeepSeek V3在中文创意写作、角色扮演和长文本理解方面表现尤为突出
75%UnverifiedGemini, Claude, and DeepSeek V3 all support Function Calling.
60%UnverifiedSome Claude Code features are tuned for Anthropic model characteristics, and after switching to other models the stability of tool calls and long-context performance may differ.
50%UnverifiedIn FP8 mixed-precision training, V3 uses FP8 computation for most matrix multiplications and retains higher precision for precision-sensitive steps, theoretically doubling compute throughput and halving memory usage compared with BF16.
50%UnverifiedDeepSeek V3, released on December 26, 2024, has 671 billion total parameters and 37 billion activated parameters, uses FP8 training, reports a compute cost of $5.576 million in its paper, and matches GPT-4o in performance.
50%UnverifiedNexus-CLI supports DeepSeek R1/V3 as backend inference engines while being compatible with Claude Code's interaction protocol and Ollama's model management interface.
50%UnverifiedNexus-CLI is a CLI tool implemented in pure Go, used to bridge the DeepSeek R1/V3 models with the Claude Code and Ollama ecosystems.
50%UnverifiedOn the prefill sizes of DeepSeek V2 and V3, FlyDSL Flex Attention achieved close to a 2x improvement.
50%UnverifiedThe Mixture of Experts (MoE) architecture is the core design adopted by a new generation of large models such as DeepSeek V3, where a routing mechanism dynamically selects a small number of experts to activate each time an input is processed.
50%UnverifiedThe decode unit of DeepSeek V3 uses 144-card EP, amortizing the weight load overhead across large batches and freeing up GPU memory to increase batch size.
50%UnverifiedMost of Sebastian's course code runs on a Mac mini; the goal of the course is to demonstrate the principles of reasoning techniques using small models, rather than to replicate ultra-large models such as DeepSeek V3/V4.
50%UnverifiedThe article recommends integrating the official release of DeepSeek V3 into Claude Code, citing its excellent performance, fast speed, affordable pricing, and the absence of compliance risks since data flows domestically.
50%UnverifiedQwen 2.5 and DeepSeek V3 are major releases involving entirely new pre-training processes and architectural improvements.
50%UnverifiedTechniques such as GQA and MLA can significantly compress KV cache size; DeepSeek V3 adopts MLA to reduce memory overhead in long-context scenarios.
50%