See or Say Graphs: Agent-Driven Scalable Graph Understanding with Vision-Language Models

Shuo Han, Yukun Cao, Zezhong Ding, Zengyi Gao, S Kevin Zhou, Xike Xie


Abstract
Vision-language models (VLMs) have shown promise in graph understanding, but remain limited by input-token constraints, facing scalability bottlenecks and lacking effective mechanisms to coordinate textual and visual modalities. To address these challenges, we propose GraphVista, a unified framework that enhances both scalability and modality coordination in graph understanding. For scalability, GraphVista organizes graph information hierarchically into a lightweight GraphRAG base, which retrieves only task-relevant textual descriptions and high-resolution visual subgraphs, compressing redundant context while preserving key reasoning elements. For modality coordination, GraphVista introduces a planning agent that routes tasks to the most suitable modality—using the text modality for simple property reasoning and the visual modality for local and structurally complex reasoning grounded in explicit topology. Extensive experiments demonstrate that GraphVista scales to large graphs, up to 200× larger than those used in existing benchmarks, and consistently outperforms existing textual, visual, and fusion-based methods, achieving up to 4.4× quality improvement over the state-of-the-art baselines by fully exploiting the complementary strengths of both modalities.
Anthology ID:
2026.findings-acl.2066
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
41565–41589
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.2066/
DOI:
Bibkey:
Cite (ACL):
Shuo Han, Yukun Cao, Zezhong Ding, Zengyi Gao, S Kevin Zhou, and Xike Xie. 2026. See or Say Graphs: Agent-Driven Scalable Graph Understanding with Vision-Language Models. In Findings of the Association for Computational Linguistics: ACL 2026, pages 41565–41589, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
See or Say Graphs: Agent-Driven Scalable Graph Understanding with Vision-Language Models (Han et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.2066.pdf
Checklist:
 2026.findings-acl.2066.checklist.pdf