Unverified50% confidenceBenchmarkExact time
Even under temperature 0 conditions, 0.07% to 10.2% of rows across five executions still change their operator output, with the exact proportion depending on the model
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedOn one task, the proportion of rows that change operator output under temperature 0 reached as high as 24.0%78% similarUnverifiedIn the Soai reaction, even if the initial chiral imbalance is less than 0.00005%, the enantiomeric excess (ee value) of the product can exceed 99.5% after multiple cycles.73% similarUnverifiedDifferent hyperparameters such as system prompt, temperature, maximum token count, and number of retries can cause the evaluation results of the same model to differ by more than 10 percentage points.72% similarUnverifiedAs the model scales from 8B to 70B, the predictive power of fixed output vector similarity for behavior actually worsens, with a paired mean correlation change of -0.080 (95% confidence interval [-0.127, -0.035]).68% similarUnverified一个61分的模型和一个59分的模型在多数实际应用中的差异可能远小于分数暗示的程度67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1001995API
curl https://kongchang.com/api/v1/knowledge/claims/1001995MCP
get_claim(id=1001995)