Unverified50% confidenceBenchmarkExact time
With 8 concurrent users, each gets 19 tokens/s, for a total of 130 tokens/s, with first-token latency of 2 to 8 seconds
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/17/2026
First Seen
Valid until: 10/31/2026
Sources
Related Entities
Related Claims
UnverifiedIt is generally considered that single-concurrency output above 100 tokens/second is sufficient to achieve a smooth typewriter effect, and at approximately 200 tokens/second, generating a 2,000-character long text takes only about 10 seconds.76% similarVerifiedIn decode speed tests, speeds of approximately 45 tokens/second are achievable within 20,000 tokens, dropping sharply to approximately 20 tokens/second beyond 30,000 tokens.75% similarUnverifiedPerplexity published self-tested latency (September 30): under 2 seconds for a few hundred input tokens, about 5 seconds for 90k tokens, about 14 seconds for 190k tokens, and about 23 seconds near the 262k limit.74% similarUnverifiedIn concurrent scenarios, generation speed is evenly distributed among multiple requests; for example, at 40 token/s for a single request, each of 4 concurrent requests gets approximately 10 token/s73% similarUnverifiedIn a test scenario where eight agents each process 7.5k-token documents and a chat request is issued in the second second, Superfluid answers in 0.36 seconds while llama-server outputs no first token for more than 10 seconds, a first-token latency gap of about 30 times.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1053015API
curl https://kongchang.com/api/v1/knowledge/claims/1053015MCP
get_claim(id=1053015)