Unverified60% confidenceBenchmarkExact time
In a test of 30 Three.js One-Shot programming problems, Qwen 3.8 passed 24 and Ornith 1.5 passed 15, both running under Q6 quantization.
2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
9/11/2026
First Seen
Valid until: 12/10/2026
Sources
Related Entities
Related Claims
UnverifiedThe study tested four sizes of the Qwen3 series—0.6B, 1.7B, 4B, and 8B—running at FP16 precision, greedy decoding, a single frozen prompt, and no fine-tuning.71% similarUnverifiedThe test covered 8 local models: Qwen3's 0.6B, 1.7B, 4B, 8B, and 14B, as well as Gemma3's 1B, 4B, and 12B, all deployed via Ollama with thinking mode disabled.70% similarUnverifiedA controlled benchmark containing 24 worlds (each with exactly two possible outcomes) reproduces the failure of the complementary consistency test on all three models (Qwen3-4B, Llama-3.2-3B, Gemma-3-4B).68% similarUnverifiedIn the hard-to-verify category with injection bait, the number of questions for which GPT-5.4 mini judged incorrectly in both orderings rose from 3 to 39, Qwen3-Next 80B Instruct from 4 to 38, and GPT-5.4 mini and Qwen3-Next Instruct scored zero on hard questions (below the approximately 0.25 expected from random coin flipping).67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/902869API
curl https://kongchang.com/api/v1/knowledge/claims/902869MCP
get_claim(id=902869)