Expired50% confidenceBenchmarkExact time
OpenAI's o-series models and Anthropic's Claude 3.5 Sonnet have achieved scores on code generation benchmarks (such as HumanEval and SWE-bench) that approach or exceed the average level of human programmers.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/10/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/8/2026(expired)
Sources
What Is an FDE? Decoding the Most Sought-After Hybrid Engineer in the AI Deployment Era
bilibili码士集团-马小鱼7/8/2026
Related Claims
VerifiedThe Sonnet model underlying Claude Code consistently leads on mainstream programming benchmarks such as HumanEval and SWE-bench.77% similarUnverifiedHumanEval was developed in-house by OpenAI and is specifically designed to test the functional correctness rate of code generation.73% similarUnverifiedIn the Pillow library RGB-to-HSV precision bug test, Claude Code using the Sonnet 4.6 model passed on the first attempt with clear logic, earning a perfect score.69% similarUnverifiedThe tester used VS Code Copilot with OPAI 4.7 to design the evaluation plan, and used Sonnet 4.6 to execute the evaluation and generate the report.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/457477API
curl https://kongchang.com/api/v1/knowledge/claims/457477MCP
get_claim(id=457477)