Unverified50% confidenceFactExact time
批次归一化由 Ioffe 和 Szegedy 在 2015 年提出,通过对每个小批次输入进行标准化来加速训练并稳定梯度流动
1
Sources
50%
Confidence
Long-term
Relevance
8/5/2026
First Seen
Sources
Related Claims
UnverifiedBatch normalization was proposed by Ioffe and Szegedy in 2015, stabilizing training by normalizing activation values on each mini-batch76% similarUnverified权重归一化技术将权重向量分解为方向与模长两个独立分量分别优化,可显著改善训练稳定性62% similarUnverifiedTraining hundred-billion-parameter models such as GPT-3 requires scheduling strategies such as learning rate warmup and cosine annealing, as well as engineering techniques such as mixed-precision training and gradient accumulation.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/692359API
curl https://kongchang.com/api/v1/knowledge/claims/692359MCP
get_claim(id=692359)