Unverified50% confidenceFactExact time
传统代码评测基准（如HumanEval、MBPP）主要测试模型在孤立函数级别的生成准确率
1
Sources
50%
Confidence
Long-term
Relevance
7/6/2026
First Seen
Sources
Related Claims
Unverified当前主流基准测试体系如HumanEval、MBPP等代码评估集往往关注平均性能，对分布式的场景特定退化现象敏感度不足82% similarUnverifiedCode large language models are evaluated using executable benchmarks such as HumanEval and MBPP, meaning the generated code is directly executed and the output is checked for correctness.79% similarUnverifiedCodex模型的评估通常使用HumanEval和MBPP等编码基准测试77% similarUnverifiedCoding capability evaluation typically references standardized benchmarks such as HumanEval, MBPP, and SWE-bench, but actual engineering scenario performance differs from benchmark results.77% similarUnverifiedHumanEval and MBPP primarily measure a model's code generation capability, while code review is an essentially different task, and the industry currently lacks standardized code review benchmarks.77% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/115218API
curl https://kongchang.com/api/v1/knowledge/claims/115218MCP
get_claim(id=115218)