Unverified60% confidenceFactExact time
Qwen 3.8 (27 billion parameters, Q4 quantization) requires reading approximately 17GB of memory per token
2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
9/11/2026
First Seen
Valid until: 12/10/2026
Sources
Related Entities
Related Claims
UnverifiedWithin the Qwen3 series there is a MoE model with a total parameter count of 2.4T and approximately 95B activated parameters, and downloading the model files requires approximately 5TB of storage space.75% similarVerifiedQLoRA quantizes the base model weights in 4-bit NF4 format, making it possible to fine-tune a 13-billion-parameter model on a single GPU.73% similarVerifiedA model with 70 billion parameters that originally requires 80 GB of VRAM requires only about 40 GB of memory after 4-bit quantization (Q4_K_M level), with inference quality loss typically within 3%–8% on most benchmarks.72% similarUnverifiedRunning a 14B Q8 model typically requires at least 16 GB of memory.72% similarVerifiedQ4_K_M uses mixed precision, storing some critical weights at 6-bit and the remainder at 4-bit, with an overall average of approximately 4.5-bit.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/891801API
curl https://kongchang.com/api/v1/knowledge/claims/891801MCP
get_claim(id=891801)