Verified65% confidenceFactTime unknown
Devin resolved 13.86% of real GitHub Issues in the SWE-bench test, surpassing the performance of Claude 2.
3
Sources
65%
Confidence
Long-term
Relevance
5/31/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedDevin achieved a resolution rate of 13.86% on the SWE-bench evaluation (the highest at the time).71% similarUnverifiedDevin once set the highest score of its time on the SWE-bench benchmark.59% similarUnverifiedClaude achieved a task completion rate of 14.9% on the OSWorld benchmark, representing the highest level at the time.58% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/3203API
curl https://kongchang.com/api/v1/knowledge/claims/3203MCP
get_claim(id=3203)