Markovian Linguistic-Temporal Bridge: Unlocking the Potential of LLMs for Time Series Forecasting
Siming Sun, Kai Zhang, Xuejun Jiang, Wenchao Meng, Qinmin Yang
Abstract
Adapting pretrained Large Language Models (LLMs) for time series forecasting primarily relies on token-level linguistic-temporal alignment, leading to the stacking of logically disjointed tokens as input. While empirically effective, these methods overlook a fundamental capability of LLMs: modeling linguistic logic and structure, rather than merely processing token features. To address this limitation, we propose the Markovian-Guided Structure-Aware Alignment (MGSAA). Our core contribution is a framework that transcends pointwise feature matching to achieve global structural isomorphism between the linguistic and temporal domains. Specifically, MGSAA distills latent evolutionary patterns of language within LLMs into a Markovian state transition graph, which is transferred as a structural prior to the time series domain. Under this prior, time series patches are decoded into latent states and then aligned via state-constrained cross-attention. Ultimately, MGSAA generates a token sequence topologically isomorphic to the LLM’s inherent mental structure, reactivating its reasoning capabilities for forecasting. Comprehensive evaluations across multiple benchmarks demonstrate that MGSAA achieves state-of-the-art performance, providing an innovative solution for cross-modal alignment in LLM for time series forecasting. Code is available at https://github.com/sunzju/MGSAA.- Anthology ID:
- 2026.acl-long.1014
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 22165–22180
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.1014/
- DOI:
- Cite (ACL):
- Siming Sun, Kai Zhang, Xuejun Jiang, Wenchao Meng, and Qinmin Yang. 2026. Markovian Linguistic-Temporal Bridge: Unlocking the Potential of LLMs for Time Series Forecasting. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 22165–22180, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- Markovian Linguistic-Temporal Bridge: Unlocking the Potential of LLMs for Time Series Forecasting (Sun et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.1014.pdf