UCSC at SemEval-2025 Task 8: Question Answering over Tabular Data

Neng Wan, Sicong Huang, Esha Ubale, Ian Lane


Abstract
Table question answering (Table QA) remains challenging due to the varied structures of tables and the complexity of queries, which often require specialized reasoning. We introduce a system that leverages large language models (LLMs) to generate executable code as an intermediate step for answering questions on tabular data. The methodology uniformly represents tables as dataframes and prompts an LLM to translate natural-language questions into code that can be executed on these tables. This approach addresses key challenges by handling diverse table formats, enhancing interpretability through code execution. Experimental results on the DataBench benchmarks demonstrate that the proposed code-then-execute approach achieves high accuracy. Moreover, by offloading computation to code execution, the system requires fewer LLM invocations, thereby improving efficiency. These findings highlight the effectiveness of an LLM-based coding approach for reliable, scalable, and interpretable Table QA.
Anthology ID:
2025.semeval-1.266
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2050–2058
Language:
URL:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.266/
DOI:
Bibkey:
Cite (ACL):
Neng Wan, Sicong Huang, Esha Ubale, and Ian Lane. 2025. UCSC at SemEval-2025 Task 8: Question Answering over Tabular Data. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 2050–2058, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
UCSC at SemEval-2025 Task 8: Question Answering over Tabular Data (Wan et al., SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.266.pdf