TRACE: Traversal Retrieval-Augmented Chain of Evidence for Document Understanding

Liqi He, Zuchao Li, Hao Huang, Ping Wang


Abstract
Early Long-context Document Visual Question Answering (DocVQA) methods struggle with preserving visual semantics or handling finite context windows. Conversely, recent RAG-based approaches suffer from "semantic gaps" and "structural disconnections" due to passive retrieval mechanisms that ignore logical dependencies. To address these challenges, we introduce TRACE (Traversal Retrieval-Augmented Chain of Evidence). By navigating a Bi-Layered Graph that encodes both physical adjacency and semantic relevance, TRACE transforms retrieval from static matching into adaptive evidence chain construction. Furthermore, we propose M5BookVQA, a benchmark designed to assess deep, multi-hop reasoning in books, addressing the limitations of existing datasets. Extensive experiments show that TRACE achieves an average accuracy improvement of 14.07% on M5BookVQA and exhibits robust generalization with a 13.38% gain across four established benchmarks. Our source code is available at https://github.com/shimurenhlq/TRACE.
Anthology ID:
2026.acl-long.445
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
9806–9825
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.445/
DOI:
Bibkey:
Cite (ACL):
Liqi He, Zuchao Li, Hao Huang, and Ping Wang. 2026. TRACE: Traversal Retrieval-Augmented Chain of Evidence for Document Understanding. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 9806–9825, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
TRACE: Traversal Retrieval-Augmented Chain of Evidence for Document Understanding (He et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.445.pdf
Checklist:
 2026.acl-long.445.checklist.pdf