Unverified50% confidenceFactExact time
CPU的设计哲学是减少延迟，配备多级缓存、乱序执行引擎和分支预测器；GPU的设计哲学是隐藏延迟，通过同时调度大量线程实现
1
Sources
50%
Confidence
Long-term
Relevance
8/23/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedCPU+GPU hybrid inference uses a layer-level offloading mechanism, controlling the number of offloaded layers via the n_gpu_layers parameter; the main bottleneck is PCIe bandwidth latency, which typically reduces generation speed to 1/3 to 1/2 of pure GPU inference.77% similarUnverified采用流水线架构使GPU对第N+1帧推理时CPU同时对第N帧后处理，可使理论吞吐量取决于最慢阶段而非所有阶段时间总和71% similarUnverified专家卸载策略将不常激活的专家留在 CPU 内存，路由器选中时才临时搬运至 GPU 显存70% similarUnverifiedOnce the scale of a model and its compute demands reach a certain level, custom chips can often surpass general-purpose GPUs in both performance and cost.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/791064API
curl https://kongchang.com/api/v1/knowledge/claims/791064MCP
get_claim(id=791064)