TrustTable: A Neuro-Symbolic Auditing Framework for Faithful Table QA

Guangzhen Zhao, Dechang Kong, Tongyu Wu, Zhenjiang Dong


Abstract
Large Language Models based Table Question Answering (LLMs-based TableQA) models excel in NLP field, however, they occasionally exhibit an unfaithful behavior where correct answers are derived through erroneous reasoning paths. In this condition, we propose TrustTable, a neuro-symbolic framework designed to ensure reasoning faithfulness by auditing the reasoning processes of LLMs. Unlike monolithic LLM-based auditors, TrustTable decouples the auditing operation into two orthogonal dimensions. It enforces factual grounding by executing neurally generated Pandas code against the table, and ensures logical soundness by verifying reasoning chains through a LLM-synthesized formal solver. By integrating these symbolic checks, TrustTable enables a Label-Free Audit Loop that systematically identifies and rectifies reasoning flaws without human supervision. In addition, we present the TrustTable-Bench, a diagnostic dataset containing diverse error categories that range from calculation discrepancies to schema misalignments. This benchmark allows for a rigorous quantification of reasoning limitations. Experiments demonstrate that our symbolic audit detects reasoning flaws more accurately than advanced baselines. More broadly, the TrustTable outperforms LLM judges in both majority voting with logical weighting and rejection sampling with process supervision.
Anthology ID:
2026.acl-long.1612
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
34907–34934
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1612/
DOI:
Bibkey:
Cite (ACL):
Guangzhen Zhao, Dechang Kong, Tongyu Wu, and Zhenjiang Dong. 2026. TrustTable: A Neuro-Symbolic Auditing Framework for Faithful Table QA. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 34907–34934, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
TrustTable: A Neuro-Symbolic Auditing Framework for Faithful Table QA (Zhao et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1612.pdf
Checklist:
 2026.acl-long.1612.checklist.pdf