Unverified70% confidenceFactTime unknown
主流开源模型在消费级GPU上的推理速度通常在20-80 token/s之间
1
Sources
70%
Confidence
Long-term
Relevance
5/31/2026
First Seen
Sources
Related Claims
UnverifiedGPU utilization can rise from 20%–30% during low traffic to 70%–80% during high traffic, because larger request volumes make it easier to aggregate into larger compute batches72% similarUnverified许多推理服务的GPU利用率不足30%，通过VGPU技术可将利用率提升至70%以上72% similarUnverifiedWithout a sufficiently optimized software stack, actual GPU utilization often reaches only 30–50% of the theoretical peak.70% similarUnverifiedThe price of output tokens is typically 4–6 times that of input tokens, stemming from the computational differences between the prefill and decode phases, with GPU utilization during the decode phase potentially being only 10–20% of that during prefill70% similarUnverified同一型号GPU在不同渠道的价格差异可达20%-40%70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/6847API
curl https://kongchang.com/api/v1/knowledge/claims/6847MCP
get_claim(id=6847)