Expired65% confidenceFactExact time
Under a 4×RTX 3090 SXM4 configuration, the quantized version of GLM-5.2 achieves a token generation speed of approximately 6.3–6.8 tokens/second and a prompt evaluation speed of approximately 10.6 tokens/second.
3
Sources
65%
Confidence
Medium-term (~90 days)
Relevance
7/2/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 9/30/2026(expired)
Sources
The Complete Guide to Running GLM-5.2 Locally with 4 RTX 3090s for $4,000
bilibili程序员-智能译站6/24/2026
Related Claims
UnverifiedUnder this configuration, the 35B model achieves a measured single-user peak speed of approximately 80 tokens/second, with concurrent throughput exceeding 500 tokens/second.77% similarUnverifiedWhen running Qwen3-Next-Flash (Autoround W4A16 quantization), the prefill speed was approximately 1.3k tokens/s, and the generation speed reached 70 tokens/s (code) / 60 tokens/s (prose), with support for 128k+ long context.76% similarUnverifiedIn prefill speed tests, Halo achieved approximately 650 tokens/s while Spark achieved approximately 2000 tokens/s, with Spark being nearly three times faster.75% similarUnverifiedIn the STM32 embedded development test, the locally deployed DS4 model had an average output speed of approximately 23 tokens/second, memory usage spiked to 110 GB during inference, and the peak speed reached 83.8 tokens/second.75% similarUnverifiedUnder the M5 Ultra's 1.2 TB/s bandwidth, the theoretical speed of a 100 GB quantized model is approximately 12 tokens/s, a 200 GB model approximately 6 tokens/s, and a 300 GB model approximately 4 tokens/s.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/40845API
curl https://kongchang.com/api/v1/knowledge/claims/40845MCP
get_claim(id=40845)