Expired50% confidenceBenchmarkExact time
Top large language models have already surpassed 85% Pass@1 accuracy on the HumanEval benchmark.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/21/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/19/2026(expired)
Sources
Related Claims
UnverifiedStandardized code benchmark tests such as HumanEval show that top models have already exceeded a pass@1 score of 90%.77% similarUnverifiedOn code capability benchmarks such as HumanEval, top large language models have already achieved pass rates exceeding 90%.72% similarUnverified斯坦福HAI研究所2023年报告显示，最新LLM在HumanEval等代码基准测试中正确率已超过85%，远超2021年的不足50%68% similarUnverifiedOn the CLINC150 benchmark, 80 fine-tuning samples can bring vector routing to an accuracy of 85.9%, while a full fine-tune can exceed 96%.66% similarUnverifiedThe average human score on the ARC-AGI test is approximately 85%, while top AI models have long hovered in the 30%–60% range.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/584835API
curl https://kongchang.com/api/v1/knowledge/claims/584835MCP
get_claim(id=584835)