#SGD

Exact Tail Laws for SGD with Infinite-Variance Gradients

This article interprets the paper "Exact Tail Laws for Nonlinear SGD with Infinite-Variance Gradients," analyzing exact tail probabilities of SGD under infinite-variance gradients, core theoretical results, and experimental validation, and exploring the impact of heavy-tailed noise on optimization algorithms and practical implications.