[KongchangAI]
ConceptGlobal Gradient-aware Allocation / 全局梯度感知分配

GGA

A mixed-precision allocation method for recurrent state quantization. It allocates bit widths by evaluating the gradient sensitivity of each attention head's quantization residual to the prediction loss, reducing overall quantization error under a fixed storage budget.

Source Articles