Expired65% confidenceBenchmarkExact time
Qwen2.5-Coder-32B running with Q4 quantization on an RTX 4090 can achieve an inference speed of 40–60 tokens per second.
3
Sources
65%
Confidence
Medium-term (~90 days)
Relevance
7/12/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/10/2026(expired)
Sources
AI Coding Tool Data Leakage Risks: A Security Guide for Protecting Quantitative Strategies
bilibili国金证券宜宾营业部7/8/2026
Related Claims
VerifiedIn benchmark testing, Qwen3 27B achieved a generation speed of approximately 40-something tokens per second on 4 modified 2080 Ti cards without NVLink enabled.80% similarUnverifiedUnoptimized baseline token decoding speeds for running Qwen 3 (27B): RTX 5090 ~75, RTX 4090 ~46, RTX 3090 ~40, M5 Max 31.4, DGX Spark 12–17, Ryzen AI Max 11.5 tokens/s.78% similarUnverifiedQwen3 27B's local inference speed is approximately 10 tokens per second.77% similarUnverifiedThe typical generation speed of an NVIDIA RTX 4090 running a similarly scaled Q4 quantized model is in the range of 40–60 TPS77% similarUnverifiedThe Q4_K_M/GGUF version of Qwen 27B decodes at approximately 10.7 tok/s on the same machine, roughly 1/3.8 of the MLX version.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/489658API
curl https://kongchang.com/api/v1/knowledge/claims/489658MCP
get_claim(id=489658)