USAAR-DFKI – The Transference Architecture for English–German Automatic Post-Editing
Santanu Pal, Hongfei Xu, Nico Herbig, Antonio Krüger, Josef van Genabith
Abstract
In this paper we present an English–German Automatic Post-Editing (APE) system called transference, submitted to the APE Task organized at WMT 2019. Our transference model is based on a multi-encoder transformer architecture. Unlike previous approaches, it (i) uses a transformer encoder block for src, (ii) followed by a transformer decoder block, but without masking, for self-attention on mt, which effectively acts as second encoder combining src –> mt, and (iii) feeds this representation into a final decoder block generating pe. Our model improves over the raw black-box neural machine translation system by 0.9 and 1.0 absolute BLEU points on the WMT 2019 APE development and test set. Our submission ranked 3rd, however compared to the two top systems, performance differences are not statistically significant.- Anthology ID:
- W19-5414
- Volume:
- Proceedings of the Fourth Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2)
- Month:
- August
- Year:
- 2019
- Address:
- Florence, Italy
- Editors:
- Ondřej Bojar, Rajen Chatterjee, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, André Martins, Christof Monz, Matteo Negri, Aurélie Névéol, Mariana Neves, Matt Post, Marco Turchi, Karin Verspoor
- Venue:
- WMT
- SIG:
- SIGMT
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 124–131
- Language:
- URL:
- https://aclanthology.org/W19-5414
- DOI:
- 10.18653/v1/W19-5414
- Cite (ACL):
- Santanu Pal, Hongfei Xu, Nico Herbig, Antonio Krüger, and Josef van Genabith. 2019. USAAR-DFKI – The Transference Architecture for English–German Automatic Post-Editing. In Proceedings of the Fourth Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2), pages 124–131, Florence, Italy. Association for Computational Linguistics.
- Cite (Informal):
- USAAR-DFKI – The Transference Architecture for English–German Automatic Post-Editing (Pal et al., WMT 2019)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/W19-5414.pdf
- Data
- eSCAPE