Expand and Filter: CUNI and LMU Systems for the WNGT 2020 Duolingo Shared Task
Jindřich Libovický, Zdeněk Kasner, Jindřich Helcl, Ondřej Dušek
Abstract
We present our submission to the Simultaneous Translation And Paraphrase for Language Education (STAPLE) challenge. We used a standard Transformer model for translation, with a crosslingual classifier predicting correct translations on the output n-best list. To increase the diversity of the outputs, we used additional data to train the translation model, and we trained a paraphrasing model based on the Levenshtein Transformer architecture to generate further synonymous translations. The paraphrasing results were again filtered using our classifier. While the use of additional data and our classifier filter were able to improve results, the paraphrasing model produced too many invalid outputs to further improve the output quality. Our model without the paraphrasing component finished in the middle of the field for the shared task, improving over the best baseline by a margin of 10-22 % weighted F1 absolute.- Anthology ID:
- 2020.ngt-1.18
- Volume:
- Proceedings of the Fourth Workshop on Neural Generation and Translation
- Month:
- July
- Year:
- 2020
- Address:
- Online
- Editors:
- Alexandra Birch, Andrew Finch, Hiroaki Hayashi, Kenneth Heafield, Marcin Junczys-Dowmunt, Ioannis Konstas, Xian Li, Graham Neubig, Yusuke Oda
- Venue:
- NGT
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 153–160
- Language:
- URL:
- https://aclanthology.org/2020.ngt-1.18
- DOI:
- 10.18653/v1/2020.ngt-1.18
- Cite (ACL):
- Jindřich Libovický, Zdeněk Kasner, Jindřich Helcl, and Ondřej Dušek. 2020. Expand and Filter: CUNI and LMU Systems for the WNGT 2020 Duolingo Shared Task. In Proceedings of the Fourth Workshop on Neural Generation and Translation, pages 153–160, Online. Association for Computational Linguistics.
- Cite (Informal):
- Expand and Filter: CUNI and LMU Systems for the WNGT 2020 Duolingo Shared Task (Libovický et al., NGT 2020)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2020.ngt-1.18.pdf
- Data
- Duolingo STAPLE Shared Task