Unverified50% confidenceFactExact time
Performing SVD on the projection matrix W yields a text subspace corresponding to 512 non-zero singular values and null-space directions corresponding to 256 zero singular values.
1
Sources
50%
Confidence
Long-term
Relevance
10/28/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSVD将任意m×n矩阵A分解为U·Σ·V^T，图像压缩通过只保留前k个最大奇异值实现最优低秩逼近（Eckart-Young定理）74% similarUnverifiedSVDQuant将权重矩阵分解为高精度（16-bit）的低秩分支和4-bit量化的残差分支73% similarUnverifiedUsing PCA to compress layers 2 and 6 to 256 dimensions (fitted on 1400 clips from 4 external audio datasets, without using MAEB/MSEB data), injecting into the null space and normalizing, text embeddings remain bit-for-bit unchanged, and text-to-audio retrieval changes by within 0.05 points.61% similarVerifiedMLA compresses KV pairs into a low-dimensional latent space for caching and recovers the full Keys and Values via an up-projection matrix during inference, compressing the KV cache by several times.60% similarUnverifiedThe paper "AttSVD: Prompt-Adaptive Low-Rank KV Cache Compression via Attention-Guided SVD" was published on arXiv.59% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1108285API
curl https://kongchang.com/api/v1/knowledge/claims/1108285MCP
get_claim(id=1108285)