Unverified50% confidenceReleaseExact time
Unsloth推出的1-bit量化版本将27B参数级别的模型压缩至仅6-8GB
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
8/24/2026
First Seen
Valid until: 11/22/2026
Sources
Related Entities
Related Claims
UnverifiedThe original QW3.6 27B model file size is approximately 54 GB; Prismo compresses it to under 4 GB through mathematical compression techniques, a compression ratio of more than 13×, and claims this does not affect model performance.78% similarUnverifiedFP8 quantization can compress the weights of a 7B model from approximately 14GB (FP16) to approximately 7GB.76% similarUnverifiedQ3_K_M compresses each weight to approximately 3 bits, reducing the weight size of a 27B model to approximately 12–13 GB.76% similarVerifiedModels with 32B parameters can typically be compressed to approximately 16–20 GB of VRAM usage after quantization, and can be run on a single NVIDIA RTX 4090 (24 GB VRAM).75% similarUnverified动态GGUF的UD-IQ2_XXS档位将原始BF16模型体积从54.7GB压缩到约9GB，体积压缩率83.5%，准确率保留82.5%74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/795639API
curl https://kongchang.com/api/v1/knowledge/claims/795639MCP
get_claim(id=795639)