Conceptexecution validity
Execution Validity
A metric measuring whether generated SQL can execute on the target database without syntax errors and return non-empty results. It reflects whether a query runs successfully and is a different level of evaluation from execution accuracy.
Timeline (last 90 days)
Oct 27
On the Beaver benchmark, the execution validity of this method reaches 95.7%, compared with 60.8% for embedding-based retrieval.
Unverified50%