Unverified50% confidenceBenchmarkExact time
When option order is reversed, the open-weight model Laya changes 30% of its answers.
1
Sources
50%
Confidence
Long-term
Relevance
10/5/2026
First Seen
Sources
Related Entities
Related Claims
Unverified修复前模型每约29次下一token预测中约有1次的选择与数学上应有结果不同68% similarUnverifiedThe impact of reasoning-chain corruption on final answers was relatively small (2%–30%), and only 2.9%–35.3% of support-judgment flips co-occurred with answer changes.68% similarUnverified当相关文档被放置在上下文中间位置时，模型正确回答率相比放在首尾位置下降高达20-30个百分点67% similarUnverifiedLayla is extremely sensitive to the number of options and their positions; on 77 classification tasks its accuracy drops to 0.425, and shuffling the option order causes 20% of answers to flip.64% similarUnverifiedDemo three introduces a decision rule: the top option must reach at least 80% and exceed the second-best option by 20 percentage points; otherwise, the output is "request clarification."64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/975585API
curl https://kongchang.com/api/v1/knowledge/claims/975585MCP
get_claim(id=975585)