Unverified50% confidenceFactExact time
Benchmark saturation refers to the loss of discriminative power of a benchmark when multiple models approach perfect scores on it, prompting the community to introduce new evaluation standards such as GPQA and SWE-bench.
1
Sources
50%
Confidence
Long-term
Relevance
8/30/2026
First Seen
Sources
Related Entities
Related Claims
Unverified评测游戏（Benchmark Gaming）指AI公司通过选择性使用特定基准测试来最大化模型表现分数的行为，包括数据污染和针对特定评测集过度优化69% similarUnverified任何性能宣称都应指向具体Benchmark并注明版本及测试机构，否则缺乏科学依据66% similarUnverified基准测试本身就是一种数据激活的手段，为领域数据赋予清晰的优化方向66% similarUnverifiedBenchmark hacking refers to models potentially being optimized for specific test sets rather than possessing general capabilities, resulting in a gap between benchmark scores and real-world performance.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/823884API
curl https://kongchang.com/api/v1/knowledge/claims/823884MCP
get_claim(id=823884)