Beaver
A benchmark dataset for enterprise-level Text-to-SQL, collected from real enterprise databases. Its schema documentation is incomplete, and a substantial semantic gap exists between table names and business terminology, making it closer to production environments than academic benchmarks.
Timeline (last 90 days)
On the Beaver benchmark, the execution validity of this method reaches 95.7%, compared with 60.8% for embedding-based retrieval.
Beaver is a benchmark dataset for enterprise-level Text-to-SQL, collected from real enterprise databases, with incomplete schema documentation and a large semantic gap between table names and business terms, making it closer to production environments than academic benchmarks such as Spider.
All Facts (2)
On the Beaver benchmark, the execution validity of this method reaches 95.7%, compared with 60.8% for embedding-based retrieval.
50%UnverifiedBeaver is a benchmark dataset for enterprise-level Text-to-SQL, collected from real enterprise databases, with incomplete schema documentation and a large semantic gap between table names and business terms, making it closer to production environments than academic benchmarks such as Spider.
50%