Expired60% confidenceOpinionExact time
Analysis speculates that the model is an MoE model with 2 to 4 trillion parameters, activating only approximately 150 billion parameters per token.
2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
7/8/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/6/2026(expired)
Sources
Related Claims
UnverifiedA model with 100 billion parameters requires approximately 80 GB of VRAM to process a single inference request, while a model with tens of billions of parameters requires only about 20 GB.77% similarUnverifiedThe model places n-gram lookup tables at layers 1 and 14, with 24 hashes each indexing approximately 16 million rows, totaling 196 billion parameters, exceeding one-third of the model's weights.77% similarUnverifiedThe full Neural 3 model with 121 million parameters has an actual computational load roughly equivalent to a 50-million-parameter model.76% similarVerifiedIf a MoE model activates only approximately 1/8 of its parameters per inference, the actual computational overhead may be equivalent to that of a dense model with tens of billions of parameters.75% similarUnverifiedThe GPU resources required for a single inference of a hundred-billion-parameter flagship model may be 10 to 20 times higher than those of a ten-billion-parameter model.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/291491API
curl https://kongchang.com/api/v1/knowledge/claims/291491MCP
get_claim(id=291491)