Unverified50% confidenceFactExact time
The Universal Transformer proposed by Dehghani et al. in 2019 was the first to design Transformer layers as repeatable recurrent units, and introduced an adaptive computation time mechanism to dynamically determine the number of recurrent iterations.
1
Sources
50%
Confidence
Long-term
Relevance
9/4/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSwitch Transformer and the Mixtral series have widely adopted the MoE architecture.70% similarUnverifiedNVIDIA launched the Transformer Engine alongside the H100, which maintains historical maximum absolute value statistics of activations for each tensor and dynamically adjusts scaling factors.68% similarUnverified深度递归指对单一输入快照的同一状态执行多轮迭代计算，Universal Transformer、DEQ等架构是代表68% similarUnverifiedThe Transformer architecture uses a Self-Attention mechanism to achieve efficient parallel processing of sequential data, replacing RNN/LSTM architectures.67% similarVerifiedFLUX adopts a DiT (Diffusion Transformer) architecture, replacing the traditional U-Net structure with a pure Transformer.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/852181API
curl https://kongchang.com/api/v1/knowledge/claims/852181MCP
get_claim(id=852181)