Expired50% confidenceBenchmarkExact time
In this evaluation, Claude had a median latency of 22.0 seconds, averaged 3.5 searches, and answered 21 questions correctly; OpenAI real-time had a median of 5.7 seconds and answered 22 correctly; OpenAI cached had a median of 6.2 seconds and answered 24 correctly; Kimi K3 had a median of 25.9 seconds and answered 21 correctly; and local Qwen had a median of 31.1 seconds and answered 9 correctly.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/16/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/30/2026(expired)
Sources
Related Entities
Related Claims
UnverifiedThe model gave the correct answer of 34 in a multimodal image recognition test counting pencils, at a speed of 55 tokens per second at that time.68% similarUnverifiedPerplexity Decider V1.1 27B topped the evaluation with a score of 80/82, a median latency of 0.445 seconds, and zero flips across 26 reversal tests.67% similarUnverifiedUnder a 15-minute time limit per problem, the proof agent achieved a successful proof rate of 34.9% (157/450) on StochBench.67% similarUnverifiedIn a model comparison test, qwen2.5:3b correctly understood pace, produced 0 hallucinated place names, had a length error of 0.3%, peak memory of 259 MB, and took 106 seconds.66% similarUnverifiedIn a 14-question test for fixing real bugs, DevStral and Qwen3 each fixed 12, with an average of no more than 97 seconds per question.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1045031API
curl https://kongchang.com/api/v1/knowledge/claims/1045031MCP
get_claim(id=1045031)