Unverified50% confidenceDecision RuleExact time
A confidence score given by a model (e.g., 90%) should not be interpreted as 'the model is correct 90% of the time'; accuracy must be empirically measured using your own samples.
1
Sources
50%
Confidence
Long-term
Relevance
9/18/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedWhen samples are severely imbalanced, Accuracy becomes misleading—a model that predicts everyone as healthy can still achieve an accuracy of over 99%.77% similarUnverified'99% 准确率'的模型在生产环境中仍可能频繁出错，因为剩余的 1% 往往对应现实中最关键的长尾细节场景74% similarVerifiedIn scenarios with extreme class imbalance, even an accuracy as high as 95% may indicate that the model is completely unable to identify the minority class.73% similarUnverified当所有模型在某评测上都能拿90分时该评测就应退场，即基准饱和现象73% similarUnverifiedThe 2023 TruthfulQA benchmark showed that even the strongest models at the time did not exceed 60% accuracy on questions requiring precise factual judgment.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/931423API
curl https://kongchang.com/api/v1/knowledge/claims/931423MCP
get_claim(id=931423)