Verified65% confidenceOpinionExact time
Because the Transformer self-attention mechanism exhibits positional bias, earlier input content has a stronger anchoring effect on subsequent generation, which is the underlying reason for the context anchoring effect of system prompts
3
Sources
65%
Confidence
Long-term
Relevance
7/19/2026
First Seen
Sources
Related Claims
UnverifiedTransformer注意力层存在位置偏置，模型对序列起始位置(primacy bias)和末尾位置(recency bias)的关注天然高于中间段落82% similarUnverified各向异性现象的根源在于Transformer的自注意力机制和残差连接结构，使高频词的梯度信号主导嵌入空间整体方向81% similarVerifiedIn the attention mechanism of the Transformer architecture, as sequence length increases, the attention scores of early tokens are diluted by subsequent tokens after softmax normalization, forming an attention sinking effect.79% similarUnverifiedWhen text instructions precede image input, the Transformer's cross-attention mechanism causes the model to have already formed clear query vectors when encoding the image, preferentially activating visual regions semantically related to the target.77% similarUnverifiedResearch has found that there are highly similar feature representations across different layers of a Transformer, and many attention heads contribute negligibly to final performance.77% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/565064API
curl https://kongchang.com/api/v1/knowledge/claims/565064MCP
get_claim(id=565064)