Verified65% confidenceFactExact time
Prompt Caching refers to LLM service providers caching repeatedly occurring prefix content in requests, with cache hits reducing computational cost and latency.
3
Sources
65%
Confidence
Long-term
Relevance
9/25/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedContext Caching is a billing optimization mechanism provided by model vendors; when multiple requests share the same long prefix, cache breakpoints can be marked to reuse the already-computed KV Cache, billed at a lower unit price and reducing first-token latency.79% similarUnverifiedPrompt Caching is a mechanism provided by large-model service providers such as the Anthropic API: when the request prefix is exactly the same as that of a previous request, the server reuses the already-computed KV Cache, the cache-hit portion is billed at 0.1 times the input price, and the first cache write is billed at 1.25 times.78% similarVerifiedCaching means pre-storing recurring system prompts or long documents so that subsequent requests reuse them at a lower unit price, suitable for multi-turn Q&A or fixed knowledge base scenarios.76% similarUnverifiedPrompt Caching is suitable for scenarios such as conversational services with fixed system prompts, RAG knowledge-base question answering, tool-calling Agents, and batch standardized processing.76% similarUnverifiedA prompt cache hit requires the request prefix to be byte-for-byte identical to what was written at cache time; mixing dynamic content such as timestamps or session IDs into system prompts will cause frequent cache invalidation.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/950475API
curl https://kongchang.com/api/v1/knowledge/claims/950475MCP
get_claim(id=950475)