Unverified50% confidenceFactExact time
Regardless of the encoding scheme used, 4-bit precision can only distinguish 16 different numerical levels.
1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe FP4 format has only 4 bits (1 sign bit, 2 exponent bits, 1 mantissa bit) and can precisely represent only approximately 16 discrete values.75% similarUnverifiedINT4量化将原本由65536个不同值（FP16）表示的权重压缩到仅16个离散级别71% similarUnverifiedMixed-precision quantization applies aggressive low precision such as INT4 to backbone networks that have large parameter counts but are not precision-sensitive, while retaining INT8 or FP16 for precision-sensitive components such as text encoders and QKV projections.70% similarUnverified在Transformer架构中，每个参数在BF16精度下占2字节，INT8精度下占1字节，INT4精度下占0.5字节70% similarUnverified4-bit量化只能表示16个离散值，1-bit只有2个，三元量化（-1/0/+1）只有3个可能值70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/895877API
curl https://kongchang.com/api/v1/knowledge/claims/895877MCP
get_claim(id=895877)