Unverified50% confidenceSolutionExact time
Normalizing and sorting the tool call list before generating the cache key can resolve the problem of low cache hit rates.
1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe general principle for achieving cache hits is to keep the prefix of the request context as stable as possible, placing fixed content such as system prompts and tool definitions at the very front, with per-turn user input appended at the end.71% similarUnverifiedThe non-determinism in tool call ordering causes cache keys based on request body hashes to identify functionally identical requests as different requests, resulting in cache misses.69% similarUnverified自定义工具（Custom Tool）可以将重复流程封装起来实现一键复用，绕过重复推理69% similarUnverified定期重申关键指令、将关键规则附在最新输入附近能有效刷新模型对指令的记忆69% similarUnverifiedPrompt Caching通过复用相同前缀内容的Key和Value矩阵来降低推理成本，Agent类应用因高频迭代和长上下文交互天然适合缓存优化67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/900810API
curl https://kongchang.com/api/v1/knowledge/claims/900810MCP
get_claim(id=900810)