Abstract
This paper describes Lingua Custodia’s submission to the WMT21 shared task on machine translation using terminologies. We consider three directions, namely English to French, Russian, and Chinese. We rely on a Transformer-based architecture as a building block, and we explore a method which introduces two main changes to the standard procedure to handle terminologies. The first one consists in augmenting the training data in such a way as to encourage the model to learn a copy behavior when it encounters terminology constraint terms. The second change is constraint token masking, whose purpose is to ease copy behavior learning and to improve model generalization. Empirical results show that our method satisfies most terminology constraints while maintaining high translation quality.- Anthology ID:
- 2021.wmt-1.78
- Volume:
- Proceedings of the Sixth Conference on Machine Translation
- Month:
- November
- Year:
- 2021
- Address:
- Online
- Editors:
- Loic Barrault, Ondrej Bojar, Fethi Bougares, Rajen Chatterjee, Marta R. Costa-jussa, Christian Federmann, Mark Fishel, Alexander Fraser, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Paco Guzman, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Tom Kocmi, Andre Martins, Makoto Morishita, Christof Monz
- Venue:
- WMT
- SIG:
- SIGMT
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 799–803
- Language:
- URL:
- https://aclanthology.org/2021.wmt-1.78
- DOI:
- Cite (ACL):
- Melissa Ailem, Jingshu Liu, and Raheel Qader. 2021. Lingua Custodia’s Participation at the WMT 2021 Machine Translation Using Terminologies Shared Task. In Proceedings of the Sixth Conference on Machine Translation, pages 799–803, Online. Association for Computational Linguistics.
- Cite (Informal):
- Lingua Custodia’s Participation at the WMT 2021 Machine Translation Using Terminologies Shared Task (Ailem et al., WMT 2021)
- PDF:
- https://preview.aclanthology.org/alta-23-ingestion/2021.wmt-1.78.pdf