The 2018 Shared Task on Extrinsic Parser Evaluation: On the Downstream Utility of English Universal Dependency Parsers
Murhaf Fares, Stephan Oepen, Lilja Øvrelid, Jari Björne, Richard Johansson
Abstract
We summarize empirical results and tentative conclusions from the Second Extrinsic Parser Evaluation Initiative (EPE 2018). We review the basic task setup, downstream applications involved, and end-to-end results for seventeen participating teams. Based on in-depth quantitative and qualitative analysis, we correlate intrinsic evaluation results at different layers of morph-syntactic analysis with observed downstream behavior.- Anthology ID:
- K18-2002
- Volume:
- Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies
- Month:
- October
- Year:
- 2018
- Address:
- Brussels, Belgium
- Venue:
- CoNLL
- SIG:
- SIGNLL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 22–33
- Language:
- URL:
- https://aclanthology.org/K18-2002
- DOI:
- 10.18653/v1/K18-2002
- Cite (ACL):
- Murhaf Fares, Stephan Oepen, Lilja Øvrelid, Jari Björne, and Richard Johansson. 2018. The 2018 Shared Task on Extrinsic Parser Evaluation: On the Downstream Utility of English Universal Dependency Parsers. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, pages 22–33, Brussels, Belgium. Association for Computational Linguistics.
- Cite (Informal):
- The 2018 Shared Task on Extrinsic Parser Evaluation: On the Downstream Utility of English Universal Dependency Parsers (Fares et al., CoNLL 2018)
- PDF:
- https://preview.aclanthology.org/nodalida-main-page/K18-2002.pdf
- Data
- Universal Dependencies