Unverified60% confidenceFactExact time
Mixtral 8x7B has approximately 46.7 billion total parameters, but only activates approximately 13 billion parameters per forward pass; its inference compute is close to that of a 13B model, yet it still requires approximately 90 GB of VRAM (FP16).
2
Sources
60%
Confidence
Long-term
Relevance
9/4/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedRunning an open-source model at the 70-billion-parameter scale requires at least approximately 140GB of VRAM in FP16 precision, i.e., 8 H100s in parallel.77% similarUnverifiedLLaMA-2 70B 总参数约 700 亿均匀分布于 80 层，每层约 8.75 亿参数，FP16 精度下单层约占 1.75GB 显存76% similarUnverifiedA 2.4-trillion-parameter model requires approximately 9.6 TB of VRAM in FP32, about 4.8 TB in BF16, about 2.4 TB in INT8, and about 1.2 TB in INT4.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/852492API
curl https://kongchang.com/api/v1/knowledge/claims/852492MCP
get_claim(id=852492)