Unverified50% confidenceFactExact time
After the model memorizes the training data, logit growth is constrained by the balance between weight decay and the ε hyperparameter in the Adam optimizer.
1
Sources
50%
Confidence
Long-term
Relevance
10/23/2026
First Seen
Sources
Related Entities
Related Claims
Unverified延迟解耦时如果只复制权重而重置优化器动量状态，Adam会经历bias correction阶段导致数百步训练效率损失，并可能引发训练损失突然跳升73% similarUnverifiedUnder a local quadratic model, a larger batch means fewer but longer update steps, with each step incurring a greater loss on curvature, resulting in a critical batch size that depends on the learning rate, beyond which sample efficiency declines.72% similarUnverifiedThe understanding of text-to-image models is essentially large-scale statistical association, and generation quality drops significantly when dealing with long-tail concepts that appear rarely in the training set.71% similarUnverifiedDuplicate content in training data can cause model memorization and performance degradation.70% similarUnverifiedThe double descent phenomenon occurs not only along the model size dimension, but can also appear with changes in training epochs and data volume.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1088272API
curl https://kongchang.com/api/v1/knowledge/claims/1088272MCP
get_claim(id=1088272)