Scaling Graph-Based Dependency Parsing with Arc Vectorization and Attention-Based Refinement
Nicolas Floquet, Joseph Le Roux, Nadi Tomeh, Thierry Charnois
Abstract
We propose a novel architecture for graph-based dependency parsing that explicitly constructs vectors, from which both arcs and labels are scored. Our method addresses key limitations of the standard two-pipeline approach by unifying arc scoring and labeling into a single network, reducing scalability issues caused by the information bottleneck and lack of parameter sharing. Additionally, our architecture overcomes limited arc interactions with transformer layers to efficiently simulate higher-order dependencies. Experiments on PTB and UD show that our model outperforms state-of-the-art parsers in both accuracy and efficiency.- Anthology ID:
- 2025.naacl-short.60
- Volume:
- Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers)
- Month:
- April
- Year:
- 2025
- Address:
- Albuquerque, New Mexico
- Editors:
- Luis Chiruzzo, Alan Ritter, Lu Wang
- Venue:
- NAACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 722–734
- Language:
- URL:
- https://preview.aclanthology.org/fix-sig-urls/2025.naacl-short.60/
- DOI:
- Cite (ACL):
- Nicolas Floquet, Joseph Le Roux, Nadi Tomeh, and Thierry Charnois. 2025. Scaling Graph-Based Dependency Parsing with Arc Vectorization and Attention-Based Refinement. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers), pages 722–734, Albuquerque, New Mexico. Association for Computational Linguistics.
- Cite (Informal):
- Scaling Graph-Based Dependency Parsing with Arc Vectorization and Attention-Based Refinement (Floquet et al., NAACL 2025)
- PDF:
- https://preview.aclanthology.org/fix-sig-urls/2025.naacl-short.60.pdf