Abstract
Robustness, the ability of models to maintain performance in the face of perturbations, is critical for developing reliable NLP systems. Recent studies have shown promising results in improving the robustness of models through adversarial training and data augmentation. However, in machine translation, most of these studies have focused on bilingual machine translation with a single translation direction. In this paper, we investigate the transferability of robustness across different languages in multilingual neural machine translation. We propose a robustness transfer analysis protocol and conduct a series of experiments. In particular, we use character-, word-, and multi-level noises to attack the specific translation direction of the multilingual neural machine translation model and evaluate the robustness of other translation directions. Our findings demonstrate that the robustness gained in one translation direction can indeed transfer to other translation directions. Additionally, we empirically find scenarios where robustness to character-level noise and word-level noise is more likely to transfer.- Anthology ID:
- 2023.findings-emnlp.940
- Volume:
- Findings of the Association for Computational Linguistics: EMNLP 2023
- Month:
- December
- Year:
- 2023
- Address:
- Singapore
- Editors:
- Houda Bouamor, Juan Pino, Kalika Bali
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 14114–14125
- Language:
- URL:
- https://aclanthology.org/2023.findings-emnlp.940
- DOI:
- 10.18653/v1/2023.findings-emnlp.940
- Cite (ACL):
- Leiyu Pan, Supryadi, and Deyi Xiong. 2023. Is Robustness Transferable across Languages in Multilingual Neural Machine Translation?. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 14114–14125, Singapore. Association for Computational Linguistics.
- Cite (Informal):
- Is Robustness Transferable across Languages in Multilingual Neural Machine Translation? (Pan et al., Findings 2023)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-5/2023.findings-emnlp.940.pdf