MMTabReal: Real-World Benchmark for Multimodal Table Understanding
Prasham Yatinkumar Titiya, Jainil Trivedi, Chitta Baral, Vivek Gupta
Abstract
Multimodal tables i.e. tabular layouts interleaved with charts, maps, icons, and color encodings are ubiquitous in real applications yet remain difficult for Multimodal Large Language Models (MLLMs). Despite advances in text and image understanding, systematic evaluation of table-centric multimodal reasoning is limited. We introduce MMTabReal, a MultiModal Table Benchmark, human-curated suite of 500 real-world tables paired with 4021 question–answer pairs. MMtabReal spans four question types, five reasoning categories, and eight structural archetypes. Evaluations of state-of-the-art models reveal substantial gaps, especially in visual grounding, spatial alignment, and multi-step inference, with 20–40% performance drops relative to existing benchmarks. These results highlight the need for architectures that more tightly fuse vision with tabular structure and support explicit numeric/logical operations. MMtabReal is released for evaluation only, providing a rigorous, reproducible testbed that reflects the linguistic, structural, and reasoning complexity of real-world multimodal tables. Code and data are available at: https://coral-lab-asu.github.io/mmtabreal/- Anthology ID:
- 2026.findings-acl.2047
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 41156–41176
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.2047/
- DOI:
- Cite (ACL):
- Prasham Yatinkumar Titiya, Jainil Trivedi, Chitta Baral, and Vivek Gupta. 2026. MMTabReal: Real-World Benchmark for Multimodal Table Understanding. In Findings of the Association for Computational Linguistics: ACL 2026, pages 41156–41176, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- MMTabReal: Real-World Benchmark for Multimodal Table Understanding (Titiya et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.2047.pdf