Verified65% confidenceFactExact time
The vanishing gradient problem was substantially mitigated in the 2010s through ReLU activation functions, batch normalization, and residual connections.
3
Sources
65%
Confidence
Long-term
Relevance
7/21/2026
First Seen
Sources
Related Claims
Unverified2010年后ReLU成为主流激活函数选择，其在正区间梯度恒为1，有效缓解梯度消失问题79% similarUnverified残差连接（ResNet）、层归一化（LayerNorm）等设计是为应对梯度消失与梯度爆炸问题而出现的73% similarUnverifiedThe refinement solution improved degradation control, but contrast still worsens over time and dissolve artifacts still appear in the background, meaning the problem has not been fully resolved.72% similarUnverifiedIn this study, the domain fine-tuning stage exhibited a "repair" characteristic, that is, it restored more capabilities than it newly installed.68% similarUnverifiedWith weight decay, the fixed implementation accelerates the emergence of grokking; without weight decay, it prevents accuracy collapse.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/579629API
curl https://kongchang.com/api/v1/knowledge/claims/579629MCP
get_claim(id=579629)