Unverified50% confidenceFactExact time
MoE models activate only approximately 10 out of 512 experts per token, with an effective activated parameter count of approximately 20–30B.
1
Sources
50%
Confidence
Long-term
Relevance
10/5/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedMoE模型的总参数量与激活参数量之间通常相差10-30倍77% similarUnverifiedIn MoE models, dense layer parameters typically account for less than 20% of total parameters, but every token must pass through them, so they require higher-precision protection.75% similarUnverifiedIn MoE models, each token is routed to only a small number of experts for computation, resulting in a large total parameter count but a small number of activated parameters.74% similarUnverifiedTiny-MoE模型总参数量约200M，但每个token激活的参数仅约90M74% similarUnverifiedMoE的8选2配置意味着8个专家中每次只激活2个，实际计算量仅为密集模型的约四分之一74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/978625API
curl https://kongchang.com/api/v1/knowledge/claims/978625MCP
get_claim(id=978625)