Expired50% confidenceBenchmarkExact time
20 of the 41 complete test suites achieved a perfect score of 100%, rendering the benchmark unable to differentiate among these leading models.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/11/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/25/2026(expired)
Sources
Related Entities
Related Claims
UnverifiedA hand-crafted library of 22 calculators achieved perfect accuracy on the 440 cases it supported, but abstained on the remaining cases, yielding an overall coverage rate of only 40.0%.72% similarUnverifiedAbout half of the tasks are easy for all models, with scores close to 100%; on the other half of difficult tasks, the three models scored 50%, 45%, and 23% respectively.71% similarUnverifiedDuring testing, cases emerged where a model claimed 95% confidence in a move but scored 0 points according to the evaluation criteria.71% similarUnverifiedOn a test subset of 152 completely untouched questions, anchored hybrid retrieval achieved 42.11%, while the planner-guided method reached only 36.84%.71% similarUnverifiedIn a test that used Traework to fully simulate a product development workflow, the tool retrieved more than 100 sources during the research phase, but after manual verification only about 40 were truly usable, while the other 60 needed to be discarded or re-investigated.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1000202API
curl https://kongchang.com/api/v1/knowledge/claims/1000202MCP
get_claim(id=1000202)