Expired50% confidenceBenchmarkExact time
The optimal variant showed only a 1.83% decline on the GSM8K mathematical reasoning benchmark, while the MMLU general knowledge benchmark remained unchanged.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/20/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/18/2026(expired)
Sources
Related Claims
Unverified接受率随位置逐级衰减：GSM8K从位置0的0.92下滑至约0.53，MTBench从0.78急跌至0.13，因误差在连续猜测中累积70% similarUnverified一项针对GPT-4的研究显示，对MMLU题目进行语义等价改写后，模型准确率在部分子集上下降超过10个百分点69% similarUnverifiedSelf-Consistency can bring improvements of 5–20 percentage points on mathematical reasoning benchmarks such as GSM8K.68% similarUnverifiedOn mainstream evaluations such as MMLU, HumanEval, and GSM8K, the score gaps among leading large models are often only a few percentage points.68% similarUnverifiedOn the GSM8K mathematical reasoning benchmark, Self-Consistency can improve accuracy by approximately 17 percentage points compared to single greedy decoding.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/568117API
curl https://kongchang.com/api/v1/knowledge/claims/568117MCP
get_claim(id=568117)