ConceptHiPPO初始化 / High-order Polynomial Projection Operators
HiPPO
A matrix initialization method for state space models. Using a High-order Polynomial Projection Operator, it imposes special structure on recurrent matrices, enabling models to efficiently capture long-range dependencies in sequences.
Timeline (last 90 days)
Oct 6
Early SSMs such as S4 efficiently capture long-range dependencies by applying HiPPO initialization to matrix A, while maintaining the inference efficiency of linear recurrence.
Unverified50%
Aug 25
Gu等人在2021年的HiPPO和S4工作中将状态空间模型引入深度学习,开创了结构化状态空间模型研究方向
Unverified50%