Verified80% confidenceFactTime unknown
Mainstream benchmarks for evaluating programming large models include HumanEval, MBPP, SWE-bench, and LiveCodeBench
6
Sources
80%
Confidence
Long-term
Relevance
5/31/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedHumanEval, MBPP, and SWE-bench are standard benchmark datasets specifically targeting code generation.81% similarUnverifiedSWE-bench and LiveCodeBench are relatively well-recognized industry benchmarks for evaluating code large language models79% similarVerifiedCode large language models are evaluated using executable benchmarks such as HumanEval and MBPP, meaning the generated code is directly executed and the output is checked for correctness.78% similarUnverifiedHumanEval and SWE-bench are commonly used to evaluate large model coding capabilities, MMLU and GPQA for comprehensive reasoning, and IFEval for instruction following.77% similarUnverifiedSWE-bench相比HumanEval、MBPP等传统基准更贴近实际开发场景，考验模型对大型代码库的理解、跨文件依赖追踪和缺陷定位能力76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/13594API
curl https://kongchang.com/api/v1/knowledge/claims/13594MCP
get_claim(id=13594)