Unverified50% confidenceOpinionExact time
Average accuracy conflates successes and failures and cannot tell the model "whether the intervention should be enabled at this moment."
1
Sources
50%
Confidence
Long-term
Relevance
10/28/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe study observed a clear lack of correlation between the correctness of answers and the validity of reasoning traces, with models frequently arriving at correct answers even when the reasoning traces are completely invalid.79% similarUnverifiedA simple success rate cannot capture consistency, cannot reflect performance in refusing incorrect actions, and cannot measure the severity of failure consequences.78% similarUnverifiedOptimizing single-sentence quality cannot solve process hallucination; a model may perform excellently at every local point yet be unreliable overall, and evaluation must explicitly incorporate the process dimension.77% similarVerifiedModels lacking self-verification tend to fall into a cycle of confident errors, making it difficult to reliably complete multi-step end-to-end tasks even when initial generation accuracy is relatively high.77% similarUnverifiedThe primary goal of evaluation is accuracy, not performance.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1106245API
curl https://kongchang.com/api/v1/knowledge/claims/1106245MCP
get_claim(id=1106245)