Unverified50% confidenceBenchmarkExact time
Perplexity Decider V1.1 27B topped the evaluation with a score of 80/82, a median latency of 0.445 seconds, and zero flips across 26 reversal tests.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/11/2026
First Seen
Valid until: 1/9/2027
Sources
Related Entities
Related Claims
UnverifiedIn tests covering context lengths of 512–4096, increasing the draft length from 4 tokens to 16 tokens resulted in only a 0.2%–1.3% increase in overall inference latency.66% similarUnverifiedIn a 14-question test for fixing real bugs, DevStral and Qwen3 each fixed 12, with an average of no more than 97 seconds per question.66% similarUnverifiedCaveman's fixed benchmark test results from 54 runs show a 33.2% reduction in input tokens, with all 18/18 correctness checks passing.65% similarUnverifiedZapier failed two of the three tasks in testing and ultimately scored 8 for time-to-launch, 7 for learning curve, 9 for output quality, 7 for flexibility, and 10 for cost-effectiveness, placing last.65% similarUnverifiedUnder a 15-minute time limit per problem, the proof agent achieved a successful proof rate of 34.9% (157/450) on StochBench.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/998803API
curl https://kongchang.com/api/v1/knowledge/claims/998803MCP
get_claim(id=998803)