Expired50% confidenceBenchmarkExact time
When running at 1-bit precision on an M2 Max equipped with 96GB of VRAM, generation speed for simple tasks is consistently around 28–30 tokens/second
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/20/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/18/2026(expired)
Sources
Related Claims
UnverifiedRunning the Qwen3.6 27B model on a GPU with 24 GB of VRAM, the generation speed reaches approximately 40 tokens per second without optimization, and 50–60 tokens/s after optimization.79% similarUnverifiedA tester ran a 20.7B dense model on a dual-4090 (48 GB VRAM) workstation and achieved 27.6 tokens per second, only slightly faster than Dwarf Star, but with over 10 times fewer parameters.77% similarUnverifiedOn high-performance laptops, quantized Gemma models can achieve token generation speeds of 20–50 tokens per second; pure CPU inference is approximately 5–15 tokens/second, and INT4 quantization on NVIDIA RTX 4060/4070 can boost inference speed by 3–5 times.76% similarUnverifiedAfter INT4 quantization, the Qwen3-0.6B model file is only about 400 MB, retains approximately 95% of baseline capability, and an ordinary laptop CPU can achieve a generation speed of 10–30 tokens per second.75% similarUnverifiedMTP-LX with 4bit quantization achieves 40+ tokens per second generation speed on Mac, approximately double the speed of the MLX 6bit solution75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/569985API
curl https://kongchang.com/api/v1/knowledge/claims/569985MCP
get_claim(id=569985)