Text-to-TrajVis: Enabling Trajectory Data Visualizations from Natural Language Questions
Tian Bai, Huiyan Ying, Kailong Suo, Victor Junqiu Wei, Tao Fan, Yuanfeng Song
Abstract
This paper introduces the **Text-to-TrajVis** task, which aims to transform natural language questions into trajectory data visualizations, facilitating the development of natural language interfaces for trajectory visualization systems. As this is a novel task, there is currently no relevant dataset available in the community. To address this gap, we first devised a new visualization language called Trajectory Visualization Language (TVL) to facilitate querying trajectory data and generating visualizations. Building on this foundation, we further proposed a dataset construction method that integrates Large Language Models (LLMs) with human efforts to create high-quality data. Specifically, we devised a four-stage pipeline that begins with candidate extraction, proceeds through seed TVL generation and tree-based expansion, and concludes with LLM-driven question creation followed by human validation. This process results in the creation of the first large-scale Text-to-TrajVis dataset, named **TrajVL**, which contains 9,608 (question, TVL) pairs. We propose a framework called **TRCAT** for progressively converting natural language questions into TVLs. The framework incorporates TVL-RAG Chain Module and Area-Time Standardization Module, significantly enhancing the accuracy of LLMs in TVL generation. Based on the TrajVL dataset, we conduct a comprehensive evaluation of TRCAT’s performance across several mainstream LLMs (e.g., GPT, Qwen, LLaMA, and Gemma). Furthermore, we established a benchmarking system for this task, providing a foundation for future research in structured trajectory language generation.- Anthology ID:
- 2026.findings-acl.972
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 19456–19475
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.972/
- DOI:
- Cite (ACL):
- Tian Bai, Huiyan Ying, Kailong Suo, Victor Junqiu Wei, Tao Fan, and Yuanfeng Song. 2026. Text-to-TrajVis: Enabling Trajectory Data Visualizations from Natural Language Questions. In Findings of the Association for Computational Linguistics: ACL 2026, pages 19456–19475, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- Text-to-TrajVis: Enabling Trajectory Data Visualizations from Natural Language Questions (Bai et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.972.pdf