Findings of the WMT 2018 Shared Task on Quality Estimation
Lucia Specia, Frédéric Blain, Varvara Logacheva, Ramón F. Astudillo, André F. T. Martins
Abstract
We report the results of the WMT18 shared task on Quality Estimation, i.e. the task of predicting the quality of the output of machine translation systems at various granularity levels: word, phrase, sentence and document. This year we include four language pairs, three text domains, and translations produced by both statistical and neural machine translation systems. Participating teams from ten institutions submitted a variety of systems to different task variants and language pairs.- Anthology ID:
- W18-6451
- Volume:
- Proceedings of the Third Conference on Machine Translation: Shared Task Papers
- Month:
- October
- Year:
- 2018
- Address:
- Belgium, Brussels
- Editors:
- Ondřej Bojar, Rajen Chatterjee, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Christof Monz, Matteo Negri, Aurélie Névéol, Mariana Neves, Matt Post, Lucia Specia, Marco Turchi, Karin Verspoor
- Venue:
- WMT
- SIG:
- SIGMT
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 689–709
- Language:
- URL:
- https://aclanthology.org/W18-6451
- DOI:
- 10.18653/v1/W18-6451
- Cite (ACL):
- Lucia Specia, Frédéric Blain, Varvara Logacheva, Ramón F. Astudillo, and André F. T. Martins. 2018. Findings of the WMT 2018 Shared Task on Quality Estimation. In Proceedings of the Third Conference on Machine Translation: Shared Task Papers, pages 689–709, Belgium, Brussels. Association for Computational Linguistics.
- Cite (Informal):
- Findings of the WMT 2018 Shared Task on Quality Estimation (Specia et al., WMT 2018)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-1/W18-6451.pdf