Unverified60% confidenceFactExact time
It is generally considered that single-concurrency output above 100 tokens/second is sufficient to achieve a smooth typewriter effect, and at approximately 200 tokens/second, generating a 2,000-character long text takes only about 10 seconds.
2
Sources
60%
Confidence
Long-term
Relevance
7/16/2026
First Seen
Sources
Related Claims
UnverifiedWith 8 concurrent users, each gets 19 tokens/s, for a total of 130 tokens/s, with first-token latency of 2 to 8 seconds76% similarUnverifiedPerplexity published self-tested latency (September 30): under 2 seconds for a few hundred input tokens, about 5 seconds for 90k tokens, about 14 seconds for 190k tokens, and about 23 seconds near the 262k limit.75% similarUnverifiedLong context has little effect on generation speed: after 4K context the median time per output token is 7.6 ms, and after 256K it is 8.3 ms; but the first read of a 128K-token prompt takes 18.33 seconds, so prefix caching is critical.74% similarUnverifiedIn concurrent scenarios, generation speed is evenly distributed among multiple requests; for example, at 40 token/s for a single request, each of 4 concurrent requests gets approximately 10 token/s74% similarUnverifiedWhen the prefix cache is hit, repetitive prefill of tens of thousands of tokens can be almost entirely skipped, dropping first-token latency from seconds to milliseconds.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/530685API
curl https://kongchang.com/api/v1/knowledge/claims/530685MCP
get_claim(id=530685)