Verified80% confidenceFactTime unknown
The Attention Mechanism is the core component of the Transformer architecture and also the foundation of all current mainstream large language models.
8
Sources
80%
Confidence
Long-term
Relevance
6/2/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedCurrent mainstream large language models generally adopt the Transformer architecture, whose self-attention mechanism has a computational complexity that grows quadratically with sequence length (O(n²)) when processing long contexts.76% similarVerifiedThe memory of large language models fundamentally relies on the attention mechanism of the Transformer architecture, and its effective information capacity is limited by the number of tokens in the context window.74% similarVerifiedTransformer-based large language models use attention mechanisms to uniformly encode system prompts, user inputs, and externally retrieved content as homogenized token sequences, making it impossible for the model to distinguish trusted instructions from untrusted data at the semantic level.74% similarVerifiedTransformer achieves efficient modeling of long texts through its self-attention mechanism.71% similarUnverified提示词注入的核心原理在于LLM无法从根本上区分系统指令和用户输入，因为Transformer架构的注意力机制对所有输入token一视同仁，系统提示词与用户输入的token在数学上处于同一向量空间68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/37375API
curl https://kongchang.com/api/v1/knowledge/claims/37375MCP
get_claim(id=37375)