Unverified50% confidenceBenchmarkExact time
The SWE-bench benchmark has become the industry standard for evaluating the coding capabilities of AI agents, containing software engineering tasks extracted from real GitHub repositories.
1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedSWE Bench is a software engineering benchmark proposed by Princeton University that specifically evaluates AI models' ability to resolve real GitHub Issues.79% similarVerifiedThe most recognized evaluation benchmarks in the AI programming field include HumanEval (testing the generation of correct implementations from function docstrings) and SWE-bench (locating and fixing actual issues in real GitHub repositories).79% similarUnverifiedSWE-bench is considered by the industry to be the most practically valuable code benchmark due to its closeness to real engineering scenarios.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/895932API
curl https://kongchang.com/api/v1/knowledge/claims/895932MCP
get_claim(id=895932)