Unverified50% confidenceFactExact time
In 95.1% of model-family pairings, the NPC side has a higher failure rate, indicating that the gap is systematic rather than random fluctuation.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/22/2026
First Seen
Valid until: 1/20/2027
Sources
Related Entities
Related Claims
UnverifiedThe gap between selection and generation exceeds 50 percentage points, revealing that reliability is far lower than benchmarks suggest when users need the model to directly write out kinship terms.68% similarUnverifiedIn the WOVEN evaluation, even the strongest MLLM falls far below human level, and failure modes recur across different model families, so simply scaling up model size cannot eliminate these deficiencies.66% similarUnverifiedWhen the 95% confidence intervals of two models overlap, the ranking difference between them may not be statistically meaningful.65% similarUnverifiedUnder the condition of n=100 with an even split of positive and negative samples, the 95% confidence interval for 55% accuracy is roughly 45%–65%, which covers the 50% baseline, so the 5 percentage point gap may be random fluctuation.65% similarVerifiedIn scenarios with extreme class imbalance, even an accuracy as high as 95% may indicate that the model is completely unable to identify the minority class.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1084111API
curl https://kongchang.com/api/v1/knowledge/claims/1084111MCP
get_claim(id=1084111)