Expired50% confidenceBenchmarkExact time
In the 16 benchmarks officially published for 2.5-24, it scored 27.69 on automated tasks, with second place at 8.72, leading by about 3.2 times.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/15/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/29/2026(expired)
Sources
Related Entities
Related Claims
Unverified2.5-24 scored 48.09 in actual agent testing, compared with second place's 38.19.79% similarUnverified2.5-24 scored 80.71 in the tool sandbox test, ranking first.72% similarUnverifiedAfter 200 steps, the maximum discrepancy between the corresponding weights of the two runs reaches 0.237.71% similarUnverified2.5-24 took first place in all three instruction-following tests.70% similarUnverifiedA 360M-parameter code model trained by the trifero.ai lab under Strife Technologies initially reported 26.8% pass@1 on HumanEval, and after removing instruction data overlapping with the benchmark, the true number was 22.6%.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1035428API
curl https://kongchang.com/api/v1/knowledge/claims/1035428MCP
get_claim(id=1035428)