Verified75% confidenceFactExact time
When language models are repeatedly trained on data generated by themselves or similar models, systematic degradation occurs, with the diversity of model outputs decreasing with each generation and the tail information of the distribution gradually being lost.
3
Sources
75%
Confidence
Long-term
Relevance
9/8/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedModel collapse refers to the phenomenon whereby, after an AI model is trained on data generated by a previous-generation model, the output distribution gradually deviates from the original real data distribution across multiple generations of iteration, losing information in the tail of the distribution.79% similarUnverifiedSynthetic data used to train large language models carries the risk of 'Model Collapse'.76% similarUnverifiedExpressions like "tired" in model output occur because training data is filled with human modes of expression, representing pattern matching at the linguistic level rather than genuine state feedback.76% similarVerifiedWhen input information is incomplete, large language models complete it based on the most common patterns in their training data, which is statistically called maximum likelihood estimation.75% similarVerifiedIf the synthetic data generation process omits correlations between key variables, models trained on such data often perform poorly in real-world deployment environments.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/875669API
curl https://kongchang.com/api/v1/knowledge/claims/875669MCP
get_claim(id=875669)