Unverified50% confidenceFactExact time
Local model inference speed is approximately 1–10 tokens/second, while cloud-based APIs can reach 50–150 tokens/second.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/9/2026
First Seen
Valid until: 12/8/2026
Sources
Related Entities
Related Claims
UnverifiedIn decode speed tests, speeds of approximately 45 tokens/second are achievable within 20,000 tokens, dropping sharply to approximately 20 tokens/second beyond 30,000 tokens.77% similarUnverifiedAfter enabling MTP, inference speed fluctuates significantly, sometimes exceeding 40 tokens/second and sometimes dropping to 25 tokens/second.73% similarUnverifiedIt is generally considered that single-concurrency output above 100 tokens/second is sufficient to achieve a smooth typewriter effect, and at approximately 200 tokens/second, generating a 2,000-character long text takes only about 10 seconds.71% similarUnverifiedIn the Flappy Bird HTML game generation test, the speed without MTP enabled was 31.15 tokens/second, and reached 37.3 tokens/second with MTP enabled, an improvement of approximately 20%.66% similarUnverifiedChatGPT标准模式的输出速度通常在50-100 Token/秒左右66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/881644API
curl https://kongchang.com/api/v1/knowledge/claims/881644MCP
get_claim(id=881644)