Unverified50% confidenceOpinionExact time
The study points out that aggregated accuracy metrics systematically obscure asymmetric capabilities in multilingual factual reasoning, which is a manifestation of Simpson's paradox.
1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn class-imbalanced scenarios, accuracy alone can be misleading and needs to be combined with a confusion matrix for more fine-grained evaluation.72% similarUnverifiedLarge language models carry a hallucination risk in numerical reasoning and may produce errors in scenarios such as aggregate calculations, time-range filtering, or multi-table joins.68% similarUnverified精确数值计算需要严格遵循确定性规则,这与基于统计概率的token预测机制存在根本性矛盾67% similarVerified量化会不可避免地引入精度损失,在逻辑推理等对准确性敏感的任务上可能出现性能下降67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/893875API
curl https://kongchang.com/api/v1/knowledge/claims/893875MCP
get_claim(id=893875)