Abstract
Graph-based and transition-based dependency parsers used to have different strengths and weaknesses. Therefore, combining the outputs of parsers from both paradigms used to be the standard approach to improve or analyze their performance. However, with the recent adoption of deep contextualized word representations, the chief weakness of graph-based models, i.e., their limited scope of features, has been mitigated. Through two popular combination techniques – blending and stacking – we demonstrate that the remaining diversity in the parsing models is reduced below the level of models trained with different random seeds. Thus, an integration no longer leads to increased accuracy. When both parsers depend on BiLSTMs, the graph-based architecture has a consistent advantage. This advantage stems from globally-trained BiLSTM representations, which capture more distant look-ahead syntactic relations. Such representations can be exploited through multi-task learning, which improves the transition-based parser, especially on treebanks with a high ratio of right-headed dependencies.- Anthology ID:
- 2020.iwpt-1.4
- Volume:
- Proceedings of the 16th International Conference on Parsing Technologies and the IWPT 2020 Shared Task on Parsing into Enhanced Universal Dependencies
- Month:
- July
- Year:
- 2020
- Address:
- Online
- Editors:
- Gosse Bouma, Yuji Matsumoto, Stephan Oepen, Kenji Sagae, Djamé Seddah, Weiwei Sun, Anders Søgaard, Reut Tsarfaty, Dan Zeman
- Venue:
- IWPT
- SIG:
- SIGPARSE
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 25–39
- Language:
- URL:
- https://aclanthology.org/2020.iwpt-1.4
- DOI:
- 10.18653/v1/2020.iwpt-1.4
- Cite (ACL):
- Agnieszka Falenska, Anders Björkelund, and Jonas Kuhn. 2020. Integrating Graph-Based and Transition-Based Dependency Parsers in the Deep Contextualized Era. In Proceedings of the 16th International Conference on Parsing Technologies and the IWPT 2020 Shared Task on Parsing into Enhanced Universal Dependencies, pages 25–39, Online. Association for Computational Linguistics.
- Cite (Informal):
- Integrating Graph-Based and Transition-Based Dependency Parsers in the Deep Contextualized Era (Falenska et al., IWPT 2020)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2020.iwpt-1.4.pdf