Unverified50% confidenceFactExact time
The computational cost of the Transformer self-attention mechanism grows quadratically with context length, and the "Lost in the Middle" effect causes the model to extract information from the middle of the window less effectively than from the beginning and end.
1
Sources
50%
Confidence
Long-term
Relevance
10/9/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe attention mechanism of the Transformer architecture significantly reduces its focus on early content when processing very long sequences, causing the model to forget earlier settings79% similarVerifiedTransformer架构的自注意力机制在处理长序列时面临二次方复杂度的计算开销，上下文长度翻倍则计算量增长四倍78% similarUnverifiedIn Transformer models, the first and last few layers are more sensitive to quantization, the middle layers have higher redundancy, and attention layers and feed-forward network layers differ in their tolerance to quantization.77% similarUnverifiedTransformer models exhibit a "Lost in the Middle" phenomenon, where attention to content located in the middle of the context and far from the current generation position systematically decreases.75% similarVerified研究表明当上下文过长时，模型对中间部分信息的注意力会显著下降，即"Lost in the Middle"现象75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/991064API
curl https://kongchang.com/api/v1/knowledge/claims/991064MCP
get_claim(id=991064)