MMTabReal: Real-World Benchmark for Multimodal Table Understanding

Prasham Yatinkumar Titiya, Jainil Trivedi, Chitta Baral, Vivek Gupta


Abstract
Multimodal tables i.e. tabular layouts interleaved with charts, maps, icons, and color encodings are ubiquitous in real applications yet remain difficult for Multimodal Large Language Models (MLLMs). Despite advances in text and image understanding, systematic evaluation of table-centric multimodal reasoning is limited. We introduce MMTabReal, a MultiModal Table Benchmark, human-curated suite of 500 real-world tables paired with 4021 question–answer pairs. MMtabReal spans four question types, five reasoning categories, and eight structural archetypes. Evaluations of state-of-the-art models reveal substantial gaps, especially in visual grounding, spatial alignment, and multi-step inference, with 20–40% performance drops relative to existing benchmarks. These results highlight the need for architectures that more tightly fuse vision with tabular structure and support explicit numeric/logical operations. MMtabReal is released for evaluation only, providing a rigorous, reproducible testbed that reflects the linguistic, structural, and reasoning complexity of real-world multimodal tables. Code and data are available at: https://coral-lab-asu.github.io/mmtabreal/
Anthology ID:
2026.findings-acl.2047
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
41156–41176
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.2047/
DOI:
Bibkey:
Cite (ACL):
Prasham Yatinkumar Titiya, Jainil Trivedi, Chitta Baral, and Vivek Gupta. 2026. MMTabReal: Real-World Benchmark for Multimodal Table Understanding. In Findings of the Association for Computational Linguistics: ACL 2026, pages 41156–41176, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
MMTabReal: Real-World Benchmark for Multimodal Table Understanding (Titiya et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.2047.pdf
Checklist:
 2026.findings-acl.2047.checklist.pdf