Unverified50% confidenceFactExact time
Oído's int4 variant can be compressed to a size of 8.3 MB.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedQ3_K_M compresses each weight to approximately 3 bits, reducing the weight size of a 27B model to approximately 12–13 GB.73% similarUnverifiedUnder hardware conditions of 16 GB of memory, only models within 5 GB can be accommodated, so the developer used the Qwen 2.5 7B 4-bit quantized model, which is approximately 4.8 GB in size, with an 8K context window.71% similarUnverifiedThe developer provides five quantization formats: INT8 ConvRot (4.5 GB), FP8 E4M3 (4.2 GB), bf16 (8.3 GB), NVFP4 (2.9 GB), and MXFP8 (4.7 GB).70% similarUnverifiedA 70B model can be compressed to approximately 35GB at INT4 precision.70% similarVerifiedEven compressing the weights to 214GB using 4-bit quantization still far exceeds the capacity of a single 48GB GPU.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1001253API
curl https://kongchang.com/api/v1/knowledge/claims/1001253MCP
get_claim(id=1001253)