Verified65% confidenceFactExact time
HumanEval was released by OpenAI in 2021 and contains 164 hand-written Python programming problems.
3
Sources
65%
Confidence
Long-term
Relevance
9/1/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedHumanEval was proposed by OpenAI in 2021 and evaluates function-level code completion.80% similarUnverifiedOpenAI于2021年发布Codex技术报告，该模型在HumanEval基准测试上的首次通过率达28.8%，经迭代改进后超过72%64% similarUnverifiedOpenAI internally developed a text watermarking system in 2022 but shelved its release due to concerns about unfair impact on non-native English speakers, and did not reconsider deployment until 2024.60% similarVerifiedOpenAI launched the Structured Outputs feature in August 2024, whose underlying implementation is grammar-constrained sampling technology.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/839410API
curl https://kongchang.com/api/v1/knowledge/claims/839410MCP
get_claim(id=839410)