#GGUF
7 related articles
Static Detection of GGUF Parser Overflow Vulnerabilities
GGUF parsers repeatedly suffer heap out-of-bounds vulnerabilities due to file header integer overflows. This article introduces the gguf-scan static scanning tool, how it detects the CVE vulnerability cluster before loading models, and covers llama.cpp and PowerInfer advisories plus the tool's actual coverage boundaries.
GGUF vs safetensors: The Format Doesn't Decide Everything — the Runtime Does
The GGUF vs safetensors debate is often mistaken for a format war, but the real decision lies in the runtime. Through byte data and a runtime support matrix, this article shows the format is just a gate — the runtime is what matters.
Voodoo Dynamic Quant Goes Open Source: Using Gradient Descent to Optimize Model Quantization
Voodoo Dynamic Quant (VQ) is now MIT-licensed open source. It uses gradient descent to optimize per-tensor GGUF quantization, outperforming Unsloth Dynamic 3.0 at aggressive low-bit levels.
bartowski Updates GGUF Quantization: A Guide to Per-Tensor Layout Maps
bartowski updates Qwen3.8-27B-GGUF with per-tensor layout maps, making GGUF quantization internals transparent via charts and tables for local LLM users.
Product ReviewsIBM Granite 4.1 Open-Source Models: Real-World SVG Generation Comparison Across 21 GGUF Quantization Variants
IBM releases Granite 4.1 Apache 2.0 open-source LLMs. Simon Willison tests all 21 GGUF quantization variants from Unsloth, revealing that 3B model limitations overshadow precision differences.
Product ReviewsIBM Granite 4.1 Open-Source Models: Hands-On SVG Generation Test Across 21 Quantized Versions
IBM releases Granite 4.1 open-source LLMs (Apache 2.0). Simon Willison tests 21 GGUF quantized versions on SVG generation, revealing model size matters far more than quantization precision.
