Unverified50% confidenceFactExact time
The context length of mainstream open-source multimodal models is typically between 4K and 32K tokens: LLaVA-1.5 is 4,096 tokens, Qwen-VL is 8,192 tokens, and InternVL2 extends to 32K.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/10/2026
First Seen
Valid until: 12/9/2026
Sources
Related Entities
Related Claims
UnverifiedEarly LLaMA-2 only supported a 4K token context, whereas new-generation models such as DeepSeek-V3 and Qwen2.5 have extended the context to 128K or even longer.78% similarUnverifiedQwen3.6 27B supports a context length of 262K, and the 34B 80-layer version maintains the same context length unchanged72% similarUnverifiedThe official Qwen3 27B model card provides an extended scheme for scaling the context to 1 million tokens.70% similarUnverified使用IQ4_XS配合-fa 1 -ctk q8_0 -ctv q8_0对KV缓存进行q8_0量化后，可加载完整32k上下文，常驻内存约16.6GB70% similarUnverifiedOn a single 32GB GPU under q4_0 quantization, the context length increased from 82,432 tokens before the update to 199,680 tokens after the update.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/891434API
curl https://kongchang.com/api/v1/knowledge/claims/891434MCP
get_claim(id=891434)