Unverified50% confidenceBenchmarkExact time
In the fault-tolerance evaluation, all ten failure scenarios achieved the expected outcomes without producing any unauthorized external side effects.
1
Sources
50%
Confidence
Long-term
Relevance
10/7/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe researchers confirmed 91 failures through manual verification and categorized them into 7 failure loci.66% similarUnverifiedDue to non-determinism, the same Eval should be run 6 to 10 times to observe the distribution range of accuracy and calculate standard deviation and error.61% similarUnverifiedIn the demo, approximately 10 out of 11 measures were successfully converted and approved, with only 1 unsupported, resulting in an automation rate of approximately 90%61% similarUnverified一个 90% 成功、10% 出错的工具调用系统几乎无法投入实际使用，因为单次错误会污染后续上下文造成级联失败61% similarUnverifiedUsing the behavioral features of each state for failure prediction, the AUROC on the held-out set reaches as high as 0.94.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/983066API
curl https://kongchang.com/api/v1/knowledge/claims/983066MCP
get_claim(id=983066)