Unverified50% confidenceSolutionExact time
语义缓存（Semantic Cache）通过计算新查询与历史查询的向量相似度，超过阈值时直接返回缓存答案，GPTCache等开源工具实现了这一机制，通常与TTL机制结合
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
8/28/2026
First Seen
Valid until: 11/26/2026
Sources
Related Entities
Related Claims
UnverifiedAnthropic's Prompt Caching feature allows frequently repeated long contexts (such as system prompts, codebases, and documents) to be cached on the server side.69% similarUnverifiedIn the Prompt Cache mechanism, when the prefix content of an API request is identical to a previous one, the system reuses the already-computed KV cache to complete cache reads at a lower price, while cache write is the billing item for the first time content is written into the cache.67% similarUnverifiedvLLM的前缀缓存（Prefix Caching）对KV Cache块计算哈希值，当新请求输入前缀与已缓存请求重叠时直接复用物理缓存块，跳过该部分prefill计算66% similarUnverifiedThe core principle of prompt caching is cross-request reuse of the KV Cache, where already-computed KV states can be cached and reused when multiple requests share the same prefix.66% similarUnverifiedPrefix Caching technology persistently stores already-computed KV vectors on the server side, allowing direct reuse when new requests share a large number of repeated prefixes with previous requests, with the matched portion billed at the cache price.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/813718API
curl https://kongchang.com/api/v1/knowledge/claims/813718MCP
get_claim(id=813718)