[KongchangAI]
Unverified60% confidenceBenchmarkExact time

The reasoning model DeepSeek-R1 scored only 0.138, with most answers missing required fields or being unparseable, because the budget was spent on thinking rather than outputting JSON.

2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
10/11/2026
First Seen
Valid until: 1/9/2027

Sources

10 LLMs All Understood the Requirements — But Half Overstepped and Played Judge

Related Entities

DeepSeek-R1model

Related Claims

UnverifiedInference-enhanced models such as DeepSeek-R1 generate a large number of intermediate reasoning tokens before producing the final answer, and these thinking tokens are counted as output token costs.73% similar

Cite This Claim

Stable URI
https://kongchang.com/claim/999533
API
curl https://kongchang.com/api/v1/knowledge/claims/999533
MCP
get_claim(id=999533)