Unverified50% confidenceBenchmarkExact time
With an approximately 1.6M ultra-long context and 128 concurrent requests, throughput can reach approximately 3,700 tokens/s (aggregated).
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/28/2026
First Seen
Valid until: 12/27/2026
Sources
Related Entities
Related Claims
UnverifiedThe 128K character output limit is approximately equivalent to 30,000–40,000 tokens.75% similarUnverifiedCommunity benchmark comparison data: M2 Ultra approximately 20 tokens/second, M3 Ultra 512 GB at 39.8 tokens/second, a single B200 at 119.7 tokens/second, 8× RTX Pro 6000 at approximately 204 tokens/second, a modified RTX 4090 with 48 GB VRAM on a custom backend at 367 tokens/second, and dual H200 at approximately 375 tokens/second.73% similarUnverifiedIf bandwidth reached 2.4 TB/s, the theoretical speed ceiling for a 100 GB model could reach 24 tokens/s, a 60 GB model 40 tokens/s, and a 35 GB model close to 69 tokens/s.73% similarUnverifiedA speed of 4–5 tokens/second is too slow for practical use on an 8GB GPU; a 16GB GPU can improve this to 12–14 tokens/second, entering a practically usable range.73% similarUnverifiedOfficial benchmark results show that the Qwen3.6 27B dense model with NVFP4 quantization achieves 202 token/s at single concurrency, 400 token/s at dual concurrency, and 1147 token/s at 8 concurrency.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/956040API
curl https://kongchang.com/api/v1/knowledge/claims/956040MCP
get_claim(id=956040)