Verified75% confidenceFactExact time
Data contamination refers to test problems having already appeared in pretraining corpora, causing a model's high scores to more closely reflect memorization rather than reasoning.
3
Sources
75%
Confidence
Long-term
Relevance
9/21/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe data contamination problem refers to the possibility that a model may have already encountered ideas or partial proofs during training that researchers have not yet formally published.79% similarUnverifiedBenchmark contamination refers to the situation where benchmark questions have entered a model's training data, causing the model to "recall answers" rather than genuinely reason, inflating benchmark scores and failing to reflect actual capability.78% similarVerifiedWhen a model's training data contains benchmark test questions or highly similar content, the model may achieve high scores through memorization rather than genuine understanding.75% similarUnverifiedData mixture ratio refers to the proportion of different types of data in a pre-training dataset, and profoundly affects the distribution of a model's capabilities.73% similarUnverifiedOn contaminated benchmarks, models can directly extract answers from parametric memory rather than relying on in-context retrieval, rendering the reported lossless-compression conclusions meaningless.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/939212API
curl https://kongchang.com/api/v1/knowledge/claims/939212MCP
get_claim(id=939212)