Unverified50% confidenceBenchmarkExact time
The blocks.11.attn.qkv layer of ViT-Tiny has an INT8 SQNR of only 18.8 dB and an INT4 SQNR of only 7.4 dB.
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
Unverified使用IQ4_XS配合-fa 1 -ctk q8_0 -ctv q8_0对KV缓存进行q8_0量化后，可加载完整32k上下文，常驻内存约16.6GB65% similarUnverifiedViT-S版本嵌入维度为384，为每个16×16图像块输出一个384维特征向量65% similarUnverifiedOn a single RTX PRO 6000, peak VRAM for Qwen3.8-27B-NVFP4 dropped from 72.9 GB to 40.2 GB, and per-step time was reduced by approximately 11%63% similarUnverifiedOnly four source layers (kv_source_layer_ids = [2,8,14,20]) provide long-range KV, and a compression ratio is applied at each layer.63% similarUnverifiedOne B70 user running vLLM + GPT-Q INT4 quantization with MTP depth 4 achieved 84.6 tokens/s on a 27B model, but this only supports single-stream and uses different quantization, making direct comparison impossible.62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1072678API
curl https://kongchang.com/api/v1/knowledge/claims/1072678MCP
get_claim(id=1072678)