Unverified50% confidenceFactExact time
The original SWE-bench contains 2,294 tasks covering 12 Python repositories; SWE-bench Lite has 300 curated tasks, and SWE-bench Verified has 500 human-verified tasks.
1
Sources
50%
Confidence
Long-term
Relevance
10/25/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedTīrtha Bench's core test contains 800 tool-calling tasks, taken from Berkeley's publicly released BFCL dataset, of which 400 are single calls, 200 are multi-tool selection, and 200 are tasks requiring parallel calls.71% similarUnverifiedSWE-bench Lite精选了300个更具代表性的子集59% similarUnverifiedMTEB ranks 162 embedding models on 58 datasets across 8 task types.58% similarUnverifiedCMU's Odyssey benchmark contains 200 tasks, each accompanied by multiple rubrics, supporting partial scoring rather than a single binary judgment.56% similarUnverifiedTīrtha Bench currently has 68 models participating in testing, of which 8 entered the same shared comparison of 800 tasks plus 120 traps.56% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1096063API
curl https://kongchang.com/api/v1/knowledge/claims/1096063MCP
get_claim(id=1096063)