Expired50% confidenceFactExact time
In the OpenAmer ledger, goals with 20+ different tasks (that is, goals that are truly working) have pass rates ranging from 0.0% to 29.8%; one of these goals ran 63 times with zero passes.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/13/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/27/2026(expired)
Sources
Related Entities
Related Claims
UnverifiedA WANDR score of 0.610 does not mean the model fully succeeds on 60% of tasks; the actual partial completion rate is related to the distribution of task complexity.70% similarUnverifiedOpenAPPA's README claims that none of the 1,320 evaluated attacks succeeded in being scored, while completing 88% to 90% of tasks.70% similarUnverifiedThere were 100 tasks on which performance losses relative to the baseline persisted across all three repetitions, while persistent wins occurred on only 1 task.68% similarUnverifiedIn the experiment, the task_score under the shaped reward configuration was only 0.125, compared to 0.417 for the naive reward, with an effect size of d=4.47.67% similarUnverified在 Terminal Bench 2.1 测试中，OpenCode 对比里 89 个任务的失败数从 29 降到 16，多解决 13 题，分数提升 14.61 个百分点66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1018810API
curl https://kongchang.com/api/v1/knowledge/claims/1018810MCP
get_claim(id=1018810)