Dongyu Wang
2026
VET: Verifiable Execution Tracing for Reliable Text-to-SQL Generation
Dongyu Wang | Jingyu Li | Lan Zhang | Ganggang.yu | Liang Huang
Findings of the Association for Computational Linguistics: ACL 2026
Dongyu Wang | Jingyu Li | Lan Zhang | Ganggang.yu | Liang Huang
Findings of the Association for Computational Linguistics: ACL 2026
Large language models (LLMs) have shown remarkable capabilities in text-to-SQL generation, yet existing approaches remain prone to hallucinations and lack verification mechanisms. Current methods such as Chain-of-Thought (CoT) and Program-of-Thought (PoT) typically rely on intermediate reasoning that is either purely textual or executed only as a final step, leaving the reasoning process opaque and prone to grounding and logical hallucinations. In this paper, we introduce Verifiable Execution Tracing (VET), a novel reasoning paradigm that transforms text-to-SQL from unverifiable textual rationales into step-wise executable semantics. VET addresses these limitations by constraining the reasoning process within a candidate schema space and formulating it as a sequence of executable Python steps. Crucially, each step is executed against the real database to produce observable intermediate results, which serve as immediate verification feedback and transform the traditionally opaque generation process into a transparent, debuggable interaction with database reality.Experiments show consistent gains under matched, training-free settings, achieving 70.93% execution accuracy on BIRD and 37.04% on Spider 2.0-lite, with particularly strong improvements on complex queries.