Unverified50% confidenceSolutionExact time
The weight decay constant λ* introduced in the work is defined as λ* = 1 − αₗᵣ·λ, where αₗᵣ is the learning rate and λ is the original weight decay coefficient.
1
Sources
50%
Confidence
Long-term
Relevance
9/12/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedGradient descent updates parameters through the iterative formula θ = θ - α∇J(θ), where α is the learning rate and ∇J(θ) is the vector of partial derivatives of the loss function with respect to the parameters.72% similarUnverifiedThe gradient descent update rule is v → v − η∇C; since η > 0 and ‖∇C‖² ≥ 0, each update is guaranteed to decrease the cost, ΔC ≤ 0.68% similarUnverified损失函数中 tanh(β·E1·E2) 取 β=10，当 β 足够大时将乘积符号信息锐化为接近 ±1 的值65% similarUnverifiedThe load balancing loss uses the sum of squares of all expert selection frequencies L=ΣFi², and by the Cauchy–Schwarz inequality the loss is minimized when all Fi=1/N.63% similarUnverifiedGAE通过引入λ参数在偏差和方差之间折中，λ=1退化为蒙特卡洛估计，λ=0退化为单步TD估计，实践中λ=0.95左右通常能取得良好平衡62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/914991API
curl https://kongchang.com/api/v1/knowledge/claims/914991MCP
get_claim(id=914991)