Unverified50% confidenceBenchmarkExact time
FreeToken supports runtime adjustment of the GPU expert cache size; tests show that reducing the cache from 58% to 40% results in only about 10% performance loss, with performance dropping sharply below 20%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/11/2026
First Seen
Valid until: 12/10/2026
Sources
Related Entities
Related Claims
VerifiedDuring the autoregressive decoding phase, GPU compute utilization is often less than 10%, making it a memory-intensive operation.74% similarUnverifiedDuring testing, only 1 of the 4 GPUs reached a utilization rate of approximately 10%–13%, while the rest were nearly idle, and CPU usage was as high as approximately 50%.71% similarUnverified对于MuJoCo、Atari等环境,单个环境的采样速度往往跟不上GPU计算能力,导致GPU利用率长期停留在20%–40%甚至更低70% similarUnverified许多推理服务的GPU利用率不足30%,通过VGPU技术可将利用率提升至70%以上69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/897262API
curl https://kongchang.com/api/v1/knowledge/claims/897262MCP
get_claim(id=897262)