On the Continued Value of Universal Dependencies in the Era of Large Language Models

Wenxi Li, Jingyu Peng


Abstract
The necessity of explicit linguistic representations has been increasingly questioned in the era of large language models (LLMs). In this work, we revisit this issue using Universal Dependencies (UD) as a case study, examining whether and in what ways this cross-lingual syntactic framework can still benefit contemporary LLMs. We focus on a cross-lingual adversarial paraphrase identification task that is designed to foreground the role of syntactic structure in semantic interpretation across languages. Within this setting, we systematically evaluate three strategies for integrating UD into LLMs: UD-Prompt, UD-Tuning, and UD-Attention. Our experiments show that, although the magnitude of gains depends on how UD-based structural priors interact with model behavior and cross-lingual variation, UD-augmented models consistently outperform their syntax-agnostic counterparts. Across strategies, we observe average accuracy improvements of 2.67%, 8.24%, and 2.53%, respectively. These findings demonstrate that linguistic knowledge remains informative for LLMs, offering practical value in cross-lingual settings where structural alignment is challenging.
Anthology ID:
2026.acl-long.803
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
17650–17662
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.803/
DOI:
Bibkey:
Cite (ACL):
Wenxi Li and Jingyu Peng. 2026. On the Continued Value of Universal Dependencies in the Era of Large Language Models. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 17650–17662, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
On the Continued Value of Universal Dependencies in the Era of Large Language Models (Li & Peng, ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.803.pdf
Checklist:
 2026.acl-long.803.checklist.pdf