Is Incremental Structure Prediction Process Universal across Languages?: Revisiting Parsing Strategy through Speculation

Taiga Ishii, Yusuke Miyao


Abstract
While natural language is processed incrementally, it is unclear whether the syntactic structure prediction process is universal across languages or language-specific. This study investigates this question by revisiting parsing strategies of syntactic language models that incrementally predict both the next token and the associated syntactic structure. Unlike previous studies that have focused on a few strategies, we examine a wide range of strategies by introducing different parameterizations of “speculation”, which quantifies the degree to which a model predicts syntactic structure before encountering the corresponding tokens. The experiments with 10 typologically diverse languages reveal that the optimal strategy differs depending on the language and the beam size.
Anthology ID:
2025.conll-1.29
Volume:
Proceedings of the 29th Conference on Computational Natural Language Learning
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Gemma Boleda, Michael Roth
Venues:
CoNLL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
437–451
Language:
URL:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.conll-1.29/
DOI:
Bibkey:
Cite (ACL):
Taiga Ishii and Yusuke Miyao. 2025. Is Incremental Structure Prediction Process Universal across Languages?: Revisiting Parsing Strategy through Speculation. In Proceedings of the 29th Conference on Computational Natural Language Learning, pages 437–451, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Is Incremental Structure Prediction Process Universal across Languages?: Revisiting Parsing Strategy through Speculation (Ishii & Miyao, CoNLL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.conll-1.29.pdf