Verified85% confidenceBenchmarkExact time
HumanEval was developed in-house by OpenAI and is specifically designed to test the functional correctness rate of code generation.
5
Sources
85%
Confidence
Long-term
Relevance
7/17/2026
First Seen
Sources
Related Claims
VerifiedHumanEval是由OpenAI于2021年发布的代码生成基准测试，包含164个手写的Python编程问题80% similarUnverifiedScores on code generation benchmarks (such as HumanEval) are already approaching saturation.77% similarVerifiedModel evaluations in the code generation field, such as HumanEval and SWE-bench, place special emphasis on functional correctness rather than fluency.75% similarVerifiedCode large language models are evaluated using executable benchmarks such as HumanEval and MBPP, meaning the generated code is directly executed and the output is checked for correctness.74% similarVerifiedHumanEval focuses on code generation capability, testing models' logical reasoning and code correctness with 164 programming problems.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/547586API
curl https://kongchang.com/api/v1/knowledge/claims/547586MCP
get_claim(id=547586)