Unverified50% confidenceFactExact time
Transformer架构的注意力机制决定了模型只能处理当前上下文窗口内的信息
1
Sources
50%
Confidence
Long-term
Relevance
7/19/2026
First Seen
Sources
Related Claims
UnverifiedThe causal attention mask of Transformer ensures that predictions at each position depend only on historical information by setting the upper triangular portion of the attention matrix to negative infinity.76% similarUnverifiedBecause the Transformer self-attention mechanism exhibits positional bias, earlier input content has a stronger anchoring effect on subsequent generation, which is the underlying reason for the context anchoring effect of system prompts76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/559005API
curl https://kongchang.com/api/v1/knowledge/claims/559005MCP
get_claim(id=559005)