Text-to-TrajVis: Enabling Trajectory Data Visualizations from Natural Language Questions

Tian Bai, Huiyan Ying, Kailong Suo, Victor Junqiu Wei, Tao Fan, Yuanfeng Song


Abstract
This paper introduces the **Text-to-TrajVis** task, which aims to transform natural language questions into trajectory data visualizations, facilitating the development of natural language interfaces for trajectory visualization systems. As this is a novel task, there is currently no relevant dataset available in the community. To address this gap, we first devised a new visualization language called Trajectory Visualization Language (TVL) to facilitate querying trajectory data and generating visualizations. Building on this foundation, we further proposed a dataset construction method that integrates Large Language Models (LLMs) with human efforts to create high-quality data. Specifically, we devised a four-stage pipeline that begins with candidate extraction, proceeds through seed TVL generation and tree-based expansion, and concludes with LLM-driven question creation followed by human validation. This process results in the creation of the first large-scale Text-to-TrajVis dataset, named **TrajVL**, which contains 9,608 (question, TVL) pairs. We propose a framework called **TRCAT** for progressively converting natural language questions into TVLs. The framework incorporates TVL-RAG Chain Module and Area-Time Standardization Module, significantly enhancing the accuracy of LLMs in TVL generation. Based on the TrajVL dataset, we conduct a comprehensive evaluation of TRCAT’s performance across several mainstream LLMs (e.g., GPT, Qwen, LLaMA, and Gemma). Furthermore, we established a benchmarking system for this task, providing a foundation for future research in structured trajectory language generation.
Anthology ID:
2026.findings-acl.972
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
19456–19475
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.972/
DOI:
Bibkey:
Cite (ACL):
Tian Bai, Huiyan Ying, Kailong Suo, Victor Junqiu Wei, Tao Fan, and Yuanfeng Song. 2026. Text-to-TrajVis: Enabling Trajectory Data Visualizations from Natural Language Questions. In Findings of the Association for Computational Linguistics: ACL 2026, pages 19456–19475, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Text-to-TrajVis: Enabling Trajectory Data Visualizations from Natural Language Questions (Bai et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.972.pdf
Checklist:
 2026.findings-acl.972.checklist.pdf