Expired60% confidenceBenchmarkExact time
The pass rate of top models in 2025 on the HumanEval benchmark has exceeded 90%.
2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
7/20/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/18/2026(expired)
Sources
Related Claims
UnverifiedStandardized code benchmark tests such as HumanEval show that top models have already exceeded a pass@1 score of 90%.80% similarVerifiedPass rates of code generation models on benchmarks such as HumanEval jumped from 60% to over 90% between 2024 and 202576% similarUnverified自2023年GPT-4发布以来，AI在HumanEval等主流编程基准测试上的通过率从不足50%跃升至90%以上76% similarUnverifiedWhen multiple models all achieve accuracy rates above 90% on benchmarks such as MMLU and HumanEval, user attention shifts to practical metrics such as inference latency, service availability, and total cost of ownership.73% similarUnverifiedThe human baseline accuracy is 90.8%.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/575444API
curl https://kongchang.com/api/v1/knowledge/claims/575444MCP
get_claim(id=575444)