Unverified60% confidenceFactExact time
SWE-bench was released by Princeton's NLP team in 2024 and contains 2,294 real GitHub Issues from 12 mainstream open-source projects, with modifications spanning an average of 3.7 files.
2
Sources
60%
Confidence
Long-term
Relevance
7/18/2026
First Seen
Sources
Related Claims
VerifiedSWE-bench was released in 2023 by a research team at Princeton University, collecting 2,294 real GitHub Issues and their corresponding Pull Request fixes from 12 well-known Python open-source projects.84% similarUnverifiedSWE-Bench was proposed by the Princeton NLP team in 2023, crawling 2,294 real Issue-PR pairs from GitHub and covering 12 mainstream Python projects.74% similarUnverifiedSWE-bench is based on 2,294 GitHub issues from 12 real open-source projects, and the highest pass rate achieved by current systems is only around 50%.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/555185API
curl https://kongchang.com/api/v1/knowledge/claims/555185MCP
get_claim(id=555185)