Verified65% confidenceFactExact time
After 4-bit quantization, Llama 3.3 70B has a model size of approximately 40 GB and can run on a Mac Studio with 64 GB of memory or a single professional GPU with 48 GB of VRAM.
3
Sources
65%
Confidence
Long-term
Relevance
12/8/2024
First Seen
Sources
Llama 3.3 70B In-Depth Review: Testing the Strongest Open-Source LLM with 13 Questions
bilibiliAI-seeker12/8/2024
Related Entities
Related Claims
UnverifiedFull fine-tuning of Llama-3 (8B) requires approximately 80 GB or more of VRAM, while Llama-3 (70B) requires more than 400 GB.79% similarUnverified27B稠密模型在24GB M4 Pro Mac mini上使用4-bit量化可以运行，速度约为11 tok/s78% similarUnverifiedLocal inference is constrained by the user's hardware: a 7B-parameter quantized model (such as the Q4 version of Llama 3 8B) has a file size of approximately 4–5 GB, can reach 20–40 tokens per second on a Mac with an Apple M-series chip, and may drop to 3–5 tokens per second on a laptop with only an integrated GPU and 8 GB of RAM.77% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/672API
curl https://kongchang.com/api/v1/knowledge/claims/672MCP
get_claim(id=672)