Unverified50% confidenceBenchmarkExact time
Community benchmark comparison data: M2 Ultra approximately 20 tokens/second, M3 Ultra 512 GB at 39.8 tokens/second, a single B200 at 119.7 tokens/second, 8× RTX Pro 6000 at approximately 204 tokens/second, a modified RTX 4090 with 48 GB VRAM on a custom backend at 367 tokens/second, and dual H200 at approximately 375 tokens/second.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/11/2026
First Seen
Valid until: 12/10/2026
Sources
Related Entities
Related Claims
UnverifiedWhen running at 1-bit precision on an M2 Max equipped with 96GB of VRAM, generation speed for simple tasks is consistently around 28–30 tokens/second73% similarUnverifiedM3原始权重存储下限：BF16约854GB，8-bit约428GB，4-bit约214GB70% similarUnverifiedOn a single 32GB GPU under q4_0 quantization, the context length increased from 82,432 tokens before the update to 199,680 tokens after the update.70% similarUnverifiedWhen VRAM is sufficient and the model is fully resident on the GPU, an RTX 4090 running a Q4-quantized 27B model can typically achieve 15–30 tokens/s; once CPU offloading is triggered, the speed may drop sharply to 1–2 tokens/s or even lower.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/897655API
curl https://kongchang.com/api/v1/knowledge/claims/897655MCP
get_claim(id=897655)