LyS at SemEval 2025 Task 8: Zero-Shot Code Generation for Tabular QA

Adrián López Gude, Roi Santos Ríos, Francisco Prado Valiño, Ana Ezquerro, Jesús Vilares


Abstract
We developed a zero-shot pipeline that leverages an Large Language Model to generate functional code capable of extracting the relevant information from tabular data based on an input question. Our approach consists of a modular pipeline where the main code generator module is supported by additional components that identify the most relevant columns and analyze their data types to improve extraction accuracy. In the event that the generated code fails, an iterative refinement process is triggered, incorporating the error feedback into a new generation prompt to enhance robustness. Our results show that zero-shot code generation is a valid approach for Tabular QA, achieving rank 33 of 53 in the test phase despite the lack of task-specific fine-tuning.
Anthology ID:
2025.semeval-1.171
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1282–1288
Language:
URL:
https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.171/
DOI:
Bibkey:
Cite (ACL):
Adrián López Gude, Roi Santos Ríos, Francisco Prado Valiño, Ana Ezquerro, and Jesús Vilares. 2025. LyS at SemEval 2025 Task 8: Zero-Shot Code Generation for Tabular QA. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 1282–1288, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
LyS at SemEval 2025 Task 8: Zero-Shot Code Generation for Tabular QA (López Gude et al., SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.171.pdf