Expired80% confidenceFactTime unknown
Currently, the resolution rate of top models on the SWE-bench Verified subset has exceeded 50%.
7
Sources
80%
Confidence
Medium-term (~90 days)
Relevance
5/31/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 8/29/2026(expired)
Sources
Related Entities
Related Claims
UnverifiedThe pass rate of the new generation of models on real-world software engineering tasks such as SWE-bench has broken through the 50% mark for the first time.81% similarUnverifiedWhen SWE-bench was first released, the pass rate of top models was below 2%; the pass rate of leading systems has now surpassed 50%.80% similarUnverifiedEven the strongest models on SWE-Bench can only solve approximately 50% of the problems.77% similarUnverifiedOn SWE-bench, early models had a solve rate below 5%, while mainstream products in 2025 have surpassed 50%.77% similarVerifiedIn 2024, top models achieved a pass rate of approximately 50–70% on SWEbench-Verified.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/8524API
curl https://kongchang.com/api/v1/knowledge/claims/8524MCP
get_claim(id=8524)