ModelMuonW优化器
MuonW
A Muon-based optimizer variant that employs a weight-norm control method to guarantee linear cumulative effective learning rate growth.
Timeline (last 90 days)
Oct 28
The MuonW and MuonH optimizers can guarantee at least linear growth of the cumulative effective learning rate under given conditions.
Unverified50%