Unverified50% confidenceBenchmarkExact time
In this test, the prefill speed was fixed at approximately 500–600 tokens/s, and the time to first token increased linearly with input length.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/17/2026
First Seen
Valid until: 12/16/2026
Sources
Related Entities
Related Claims
UnverifiedOn an 8GB GPU, the token generation speed is approximately 4.2 to 5 tokens/second, and decreases from around 6 tokens/second to approximately 4.2 as the context grows longer.74% similarVerifiedIn decode speed tests, speeds of approximately 45 tokens/second are achievable within 20,000 tokens, dropping sharply to approximately 20 tokens/second beyond 30,000 tokens.72% similarUnverifiedIn a case test, Gemma took approximately 13.78 seconds to analyze a three-page PDF financial report, generating 1,064 tokens at a speed of 16 tokens per second.72% similarUnverifiedIn this test, the model's output speed in short-context scenarios is approximately 20 tokens/second, dropping to approximately 13 tokens/second for contexts of 200K+.71% similarVerifiedHuman reading speed is roughly 5-8 tokens per second70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/930285API
curl https://kongchang.com/api/v1/knowledge/claims/930285MCP
get_claim(id=930285)