Expired80% confidenceBenchmarkExact time
In decode speed tests, speeds of approximately 45 tokens/second are achievable within 20,000 tokens, dropping sharply to approximately 20 tokens/second beyond 30,000 tokens.
6
Sources
80%
Confidence
Medium-term (~90 days)
Relevance
7/22/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/20/2026(expired)
Sources
Related Claims
UnverifiedIn this test, the model's output speed in short-context scenarios is approximately 20 tokens/second, dropping to approximately 13 tokens/second for contexts of 200K+.79% similarUnverifiedIt is generally considered that single-concurrency output above 100 tokens/second is sufficient to achieve a smooth typewriter effect, and at approximately 200 tokens/second, generating a 2,000-character long text takes only about 10 seconds.79% similarUnverifiedAfter enabling MTP, inference speed fluctuates significantly, sometimes exceeding 40 tokens/second and sometimes dropping to 25 tokens/second.79% similarUnverifiedLocal model inference speed is approximately 1–10 tokens/second, while cloud-based APIs can reach 50–150 tokens/second.77% similarUnverifiedA typical 30-minute coding session can consume 118,000 Tokens on terminal command output alone69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/585468API
curl https://kongchang.com/api/v1/knowledge/claims/585468MCP
get_claim(id=585468)