Unverified50% confidenceBenchmarkExact time
On MBPP (Evalplus version), the score of the model with the extended vocabulary dropped slightly from 65.3% to 64.6%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/23/2026
First Seen
Valid until: 1/21/2027
Sources
Related Entities
Related Claims
UnverifiedAccording to the official explanation shown in the livestream, K3.1's model hallucination rate on financial tasks dropped by about 65%.63% similarUnverifiedOn MBPP, only 10 problems matched removed data, while the two original-data runs differed by 11 problems; the published best of 38.9% is best understood as a lucky random seed, and the run-to-run variance on MBPP is about 4 points.63% similarUnverifiedSaluki scored 78.0 on MBPP+, 67.5 on multi-step causal reasoning, and 80.0 on AIME, retaining 82%–85% of the original model's mathematical reasoning capability.61% similarUnverifiedAPRIL's final-session average scores on the ICBHI dataset were 64.4% for forward and 65.4% for reverse.61% similarUnverified一项针对GPT-4的研究显示，对MMLU题目进行语义等价改写后，模型准确率在部分子集上下降超过10个百分点61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1091084API
curl https://kongchang.com/api/v1/knowledge/claims/1091084MCP
get_claim(id=1091084)