Unverified50% confidenceBenchmarkExact time
When running Qwen3-Next-Flash (Autoround W4A16 quantization), the prefill speed was approximately 1.3k tokens/s, and the generation speed reached 70 tokens/s (code) / 60 tokens/s (prose), with support for 128k+ long context.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/13/2026
First Seen
Valid until: 12/12/2026
Sources
Related Entities
Related Claims
UnverifiedUnder a 4×RTX 3090 SXM4 configuration, the quantized version of GLM-5.2 achieves a token generation speed of approximately 6.3–6.8 tokens/second and a prompt evaluation speed of approximately 10.6 tokens/second.76% similarUnverifiedUnder this configuration, the 35B model achieves a measured single-user peak speed of approximately 80 tokens/second, with concurrent throughput exceeding 500 tokens/second.73% similarUnverifieddecode阶段的生成速度近似等于内存带宽÷模型大小，例如在内存带宽273GB/s的M4 Pro上运行4GB的Q4量化7B模型理论最大生成速度约68 tokens/s72% similarUnverifiedBased on the MLX framework, top-configured Mac models can achieve a generation speed of approximately 20 tokens/second when running the Llama-3-70B quantized model.72% similarUnverifiedIn prefill speed tests, Halo achieved approximately 650 tokens/s while Spark achieved approximately 2000 tokens/s, with Spark being nearly three times faster.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/919202API
curl https://kongchang.com/api/v1/knowledge/claims/919202MCP
get_claim(id=919202)