Unverified50% confidenceReleaseExact time
Conway Research released the model card for Saluki 27B, using IQ2 quantization to compress the 27B parameter model to approximately 7.89GB.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/10/2026
First Seen
Valid until: 1/8/2027
Sources
Related Entities
Related Claims
UnverifiedIQ2_XS can compress a model to close to 2 bits/weight, enabling a 70B model that would otherwise require 48 GB of VRAM to fit into a 24 GB consumer-grade GPU76% similarVerifiedA 30B parameter model that originally required 60 GB of VRAM can run on consumer-grade GPUs with 16 GB or even 8 GB of VRAM after quantization.71% similarVerifiedModels with 32B parameters can typically be compressed to approximately 16–20 GB of VRAM usage after quantization, and can be run on a single NVIDIA RTX 4090 (24 GB VRAM).68% similarUnverified动态GGUF的UD-IQ2_XXS档位将原始BF16模型体积从54.7GB压缩到约9GB，体积压缩率83.5%，准确率保留82.5%67% similarUnverifiedAfter quantization, the VRAM requirement of a 7-billion-parameter model is compressed from approximately 28 GB to approximately 4–6 GB, allowing consumer-grade GPUs such as the RTX 3060/4060 to run 7-billion-parameter-class models like Llama 3, Qwen2.5, and Mistral smoothly.66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/994994API
curl https://kongchang.com/api/v1/knowledge/claims/994994MCP
get_claim(id=994994)