Unverified50% confidenceBenchmarkExact time
Under this configuration, the 35B model achieves a measured single-user peak speed of approximately 80 tokens/second, with concurrent throughput exceeding 500 tokens/second.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/11/2026
First Seen
Valid until: 12/10/2026
Sources
Related Entities
Related Claims
UnverifiedIn a controlled test, the 35B model ran at approximately 100 tokens/second (Mac Studio), roughly five times the 9B model's 16 tokens/second79% similarUnverifiedUnder a 4×RTX 3090 SXM4 configuration, the quantized version of GLM-5.2 achieves a token generation speed of approximately 6.3–6.8 tokens/second and a prompt evaluation speed of approximately 10.6 tokens/second.77% similarUnverifiedIn prefill speed tests, Halo achieved approximately 650 tokens/s while Spark achieved approximately 2000 tokens/s, with Spark being nearly three times faster.77% similarUnverifiedIn the STM32 embedded development test, the locally deployed DS4 model had an average output speed of approximately 23 tokens/second, memory usage spiked to 110 GB during inference, and the peak speed reached 83.8 tokens/second.76% similarUnverifiedBased on the MLX framework, top-configured Mac models can achieve a generation speed of approximately 20 tokens/second when running the Llama-3-70B quantized model.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/902433API
curl https://kongchang.com/api/v1/knowledge/claims/902433MCP
get_claim(id=902433)