Unverified50% confidenceFactExact time
FP4-Local is not smaller than 4-bit GGUF: UD-IQ4_XS GGUF is 157 GB, while FP4-Local is about 166 GiB.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/18/2026
First Seen
Valid until: 1/16/2027
Sources
Related Entities
Related Claims
UnverifiedFP4-Local uses about 166 GiB of VRAM, and on two RTX PRO 6000 GPUs (192GB total) it can fit a 1.8M token FP8 KV cache; a dual DGX Spark setup can reach 2M tokens.75% similarUnverifiedThe Qwen3.8-Flash-Next FP4 version released by NVIDIA is about 96 GiB in size, while the original BF16 is 355 GB.73% similarUnverifiedDory's GGUF weights (Q5_K_M) are 3.67 GB, BF16 is 7.95 GB, and NVFP4 is 3.20 GB.72% similarUnverifiedA 70.6B model using the GGUF Q4_K_M format has a weight size of about 39.8 GiB.72% similarUnverifiedIn FP16 format each parameter occupies 2 bytes, while in INT4 format it occupies only 0.5 bytes, theoretically achieving a 4x compression ratio.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1064233API
curl https://kongchang.com/api/v1/knowledge/claims/1064233MCP
get_claim(id=1064233)