Unverified50% confidenceFactExact time
Singular value decomposition (SVD) factorizes any matrix into the product of two orthogonal matrices and a diagonal singular value matrix, with the singular values arranged in descending order.
1
Sources
50%
Confidence
Long-term
Relevance
10/27/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedLow-rank decomposition is typically implemented using Singular Value Decomposition (SVD), reducing the parameter count from m×n to r×(m+n).75% similarUnverifiedThe idea behind latent factor decomposition is to assume that weight matrices have redundancy and low-rank structure, and to reconstruct the original weights using a set of smaller latent factors along with indices or combination methods.71% similarUnverifiedLoRA leverages the low-rank approximation principle of SVD to decompose the incremental updates of large weight matrices into the product of two low-rank matrices, thereby compressing the number of trainable parameters from billions to the millions range.70% similarUnverifiedSVD中Σ对角线上的奇异值按从大到小排列，最大的奇异值对应数据中最重要的变化方向，较小的奇异值往往对应噪声或次要信息68% similarUnverified完整雅可比矩阵的计算代价是O(m×n)次前向传播，实际应用中研究者通常采用随机化SVD或Lanczos迭代等算法近似计算其低秩分解67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1102248API
curl https://kongchang.com/api/v1/knowledge/claims/1102248MCP
get_claim(id=1102248)