Unverified50% confidenceFactExact time
Spider is a cross-database Text-to-SQL benchmark whose outputs are highly structured with high template repetition, so n-gram hit rates are naturally favorable.
1
Sources
50%
Confidence
Long-term
Relevance
10/26/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSpider 2.0 is a Text-to-SQL benchmark targeting enterprise-grade real data warehouse scenarios, covering multiple dialects such as BigQuery, Snowflake, and SQLite, and is considered significantly harder than the original Spider.79% similarUnverifiedSpider数据集于2018年发布，包含跨越138个数据库领域的10181对自然语言-SQL对71% similarUnverifiedThe commonly used benchmarks for measuring NL2SQL system accuracy are the Spider and BIRD datasets, where Spider tests cross-domain generalization ability and BIRD more closely reflects the complexity of real enterprise databases.65% similarVerifiedThe Spider benchmark was released by Yale University in 2018 and contains more than 10,000 natural language questions and corresponding SQL queries, covering 200 databases.64% similarUnverifiedThe author states that the best-performing public Agent he knows of on the Spider 2.0-lite SQLite subset reports 57.8% Pass@1, and that it uses a different model.59% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1098264API
curl https://kongchang.com/api/v1/knowledge/claims/1098264MCP
get_claim(id=1098264)