The 2018 Shared Task on Extrinsic Parser Evaluation: On the Downstream Utility of English Universal Dependency Parsers

Murhaf Fares, Stephan Oepen, Lilja Øvrelid, Jari Björne, Richard Johansson

[How to correct problems with metadata yourself]


Abstract
We summarize empirical results and tentative conclusions from the Second Extrinsic Parser Evaluation Initiative (EPE 2018). We review the basic task setup, downstream applications involved, and end-to-end results for seventeen participating teams. Based on in-depth quantitative and qualitative analysis, we correlate intrinsic evaluation results at different layers of morph-syntactic analysis with observed downstream behavior.
Anthology ID:
K18-2002
Volume:
Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies
Month:
October
Year:
2018
Address:
Brussels, Belgium
Editors:
Daniel Zeman, Jan Hajič
Venue:
CoNLL
SIG:
SIGNLL
Publisher:
Association for Computational Linguistics
Note:
Pages:
22–33
Language:
URL:
https://aclanthology.org/K18-2002
DOI:
10.18653/v1/K18-2002
Bibkey:
Cite (ACL):
Murhaf Fares, Stephan Oepen, Lilja Øvrelid, Jari Björne, and Richard Johansson. 2018. The 2018 Shared Task on Extrinsic Parser Evaluation: On the Downstream Utility of English Universal Dependency Parsers. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, pages 22–33, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
The 2018 Shared Task on Extrinsic Parser Evaluation: On the Downstream Utility of English Universal Dependency Parsers (Fares et al., CoNLL 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/teach-a-man-to-fish/K18-2002.pdf
Data
Universal Dependencies