Unverified50% confidenceFactExact time
DeepEP provides four types of buffers: EP Buffer (for expert-parallel Dispatch and Combine), PP Buffer (for pipeline-parallel Send/Receive), Ingram Buffer (for Table writes and per-layer Fetch), and Bucket Buffer (for bucketing operations)
1
Sources
50%
Confidence
Long-term
Relevance
10/1/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedDeepSeek's prefix caching implementation is based on the MLA (Multi-head Latent Attention) architecture, which reduces the storage requirements of the KV Cache by tens of times through low-rank compression.57% similarUnverified分层存储卸载offloading实践在llama.cpp、DeepSpeed-Inference等工具中已有类似应用56% similarVerifiedQuantized KV caches (such as storing KV vectors in FP8 or INT4) can compress the cache size to 1/2 or even 1/4 of the original.56% similarUnverifiedIn DeepSeek-V4.1-Flash, only four layers are responsible for writing the compressed KV, and the rest of the model shares this cache.55% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/963581API
curl https://kongchang.com/api/v1/knowledge/claims/963581MCP
get_claim(id=963581)