On Finding the K-best Non-projective Dependency Trees

Ran Zmigrod, Tim Vieira, Ryan Cotterell


Abstract
The connection between the maximum spanning tree in a directed graph and the best dependency tree of a sentence has been exploited by the NLP community. However, for many dependency parsing schemes, an important detail of this approach is that the spanning tree must have exactly one edge emanating from the root. While work has been done to efficiently solve this problem for finding the one-best dependency tree, no research has attempted to extend this solution to finding the K-best dependency trees. This is arguably a more important extension as a larger proportion of decoded trees will not be subject to the root constraint of dependency trees. Indeed, we show that the rate of root constraint violations increases by an average of 13 times when decoding with K=50 as opposed to K=1. In this paper, we provide a simplification of the K-best spanning tree algorithm of Camerini et al. (1980). Our simplification allows us to obtain a constant time speed-up over the original algorithm. Furthermore, we present a novel extension of the algorithm for decoding the K-best dependency trees of a graph which are subject to a root constraint.
Anthology ID:
2021.acl-long.106
Volume:
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Month:
August
Year:
2021
Address:
Online
Editors:
Chengqing Zong, Fei Xia, Wenjie Li, Roberto Navigli
Venues:
ACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1324–1337
Language:
URL:
https://aclanthology.org/2021.acl-long.106
DOI:
10.18653/v1/2021.acl-long.106
Bibkey:
Cite (ACL):
Ran Zmigrod, Tim Vieira, and Ryan Cotterell. 2021. On Finding the K-best Non-projective Dependency Trees. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 1324–1337, Online. Association for Computational Linguistics.
Cite (Informal):
On Finding the K-best Non-projective Dependency Trees (Zmigrod et al., ACL-IJCNLP 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-2023-videos/2021.acl-long.106.pdf
Video:
 https://preview.aclanthology.org/ingest-acl-2023-videos/2021.acl-long.106.mp4
Code
 rycolab/spanningtrees