Unverified50% confidenceBenchmarkExact time
On the disagreement-enriched dataset, the Cohen's kappa agreement coefficient between the gpt-4o-mini judge and the gold standard jointly confirmed by two authors was only 0.04
1
Sources
50%
Confidence
Long-term
Relevance
9/28/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn a uniformly random spot-check, the gpt-4o-mini judge achieved a kappa of 0.4271% similarVerifiedOn mainstream benchmarks such as MMLU and HumanEval, the score gaps among Claude 3.5, GPT-4o, Gemini 1.5 Pro, and Grok-2 have been compressed to within the range of statistical error.68% similarUnverifiedThe best-performing Edu-QuRater achieved an average accuracy of 0.917 in reproducing GPT-4.1-mini pairwise judgments on the held-out set.68% similarUnverifiedThe study found that GPT-4's accuracy on the prime number identification task plummeted from 97.6% in March 2023 to 2.4% in June 2023.66% similarUnverifiedBrown等人2020年的GPT-3论文发现仅通过改变提示格式，同一模型在标准基准测试上的表现可相差30%以上66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/955608API
curl https://kongchang.com/api/v1/knowledge/claims/955608MCP
get_claim(id=955608)