Verified90% confidenceFactTime unknown
HumanEval was proposed by OpenAI and contains 164 Python programming problems, primarily testing function-level code generation capability
44
Sources
90%
Confidence
Long-term
Relevance
5/31/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedHumanEval由OpenAI设计，包含164道代码补全题目，考察模型将自然语言转化为可运行代码的能力85% similarVerifiedHumanEval was designed by OpenAI and contains 164 Python programming problems; GSM8K contains 8,500 elementary school math word problems; MMLU covers multiple-choice questions across 57 subject areas.75% similarUnverifiedOpenAI once conducted internal experiments with Codex, with the goal of having humans write no code by hand and only be responsible for architectural design, while leaving all coding to agents.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/9580API
curl https://kongchang.com/api/v1/knowledge/claims/9580MCP
get_claim(id=9580)