Unverified50% confidenceOpinionExact time
A total of 10T parameters most likely corresponds to an MoE model with activated parameters in the hundreds of billions, rather than a dense model.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/24/2026
First Seen
Valid until: 1/22/2027
Sources
Related Entities
Related Claims
UnverifiedIn the context of large models, '10T' may also refer to the total number of tokens in training data rather than the parameter count.77% similarVerifiedIf a MoE model activates only approximately 1/8 of its parameters per inference, the actual computational overhead may be equivalent to that of a dense model with tens of billions of parameters.73% similarUnverifiedMoE模型的总参数量与激活参数量之间通常相差10-30倍70% similarUnverifiedIn MoE models, dense layer parameters typically account for less than 20% of total parameters, but every token must pass through them, so they require higher-precision protection.70% similarUnverifiedM2.5 adopts a Mixture of Experts (MoE) architecture, where only 10B parameters are actually involved in computation during each inference, while the total parameter count may far exceed 10B.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1092582API
curl https://kongchang.com/api/v1/knowledge/claims/1092582MCP
get_claim(id=1092582)