Verified65% confidenceFactExact time
Token caching (Prompt Caching) is a cost-optimization mechanism in large model APIs; when the same prefix appears repeatedly across multiple requests, the computation result can be cached and charged at a lower rate.
3
Sources
65%
Confidence
Long-term
Relevance
9/30/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedCached input refers to pre-storing the same context on the server side so that subsequent requests can reuse the cache without repeated computation, and is billed at a lower price.79% similarVerifiedThe Prompt Caching mechanism can reuse the KV Cache of identical prefix contexts, typically reducing input token costs by 50%–90%.79% similarUnverifiedCached input tokens are a discount mechanism offered by providers such as OpenAI for large repeated prefixes (such as system prompts, long documents, and few-shot examples); input tokens that hit the cache are billed at a lower rate, usually only about one-tenth of the standard input price.79% similarUnverifiedCache hit is a billing optimization mechanism in large language model APIs, with rates typically only 1/4 or even lower than that of regular input tokens.79% similarVerifiedPrompt Caching is a cost-optimization mechanism introduced by mainstream LLM providers (such as Anthropic and OpenAI): when the prefix portion of multiple requests is completely identical, the provider caches that portion of the computation, and tokens that hit the cache are billed at a price far below normal input.78% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/962545API
curl https://kongchang.com/api/v1/knowledge/claims/962545MCP
get_claim(id=962545)