2Columns1Row: A Russian Benchmark for Textual and Multimodal Table Understanding and Reasoning
Vildan Saburov, Daniil Vodolazsky, Danil Sazanakov, Alena Fenogenova
Abstract
Table understanding is a crucial task in document processing and is commonly encountered in practical applications. We introduce 2Columns1Row, the first open-source benchmark for the table question answering task in Russian. This benchmark evaluates the ability of models to reason about the relationships between rows and columns in tables, employing both textual and multimodal inputs. 2Columns1Row consists of six datasets, 28,800 tables, that vary in the complexity of the text within the table contents and the consistency of the values in the cells. We evaluate the models using text-only and multimodal approaches and analyze their performance. Through extensive evaluation, we demonstrate the limitations of current multimodal models on this task and prove the feasibility of a dynamic text-based system utilizing our benchmark. Our results highlight significant opportunities for advancing table understanding and reasoning, providing a solid foundation for future research in this domain.- Anthology ID:
- 2025.findings-emnlp.721
- Volume:
- Findings of the Association for Computational Linguistics: EMNLP 2025
- Month:
- November
- Year:
- 2025
- Address:
- Suzhou, China
- Editors:
- Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 13370–13389
- Language:
- URL:
- https://preview.aclanthology.org/name-variant-enfa-fane/2025.findings-emnlp.721/
- DOI:
- 10.18653/v1/2025.findings-emnlp.721
- Cite (ACL):
- Vildan Saburov, Daniil Vodolazsky, Danil Sazanakov, and Alena Fenogenova. 2025. 2Columns1Row: A Russian Benchmark for Textual and Multimodal Table Understanding and Reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 13370–13389, Suzhou, China. Association for Computational Linguistics.
- Cite (Informal):
- 2Columns1Row: A Russian Benchmark for Textual and Multimodal Table Understanding and Reasoning (Saburov et al., Findings 2025)
- PDF:
- https://preview.aclanthology.org/name-variant-enfa-fane/2025.findings-emnlp.721.pdf