Multilinguality or Back-translation? A Case Study with Estonian
Elizaveta Korotkova, Taido Purason, Agnes Luhtaru, Mark Fishel
Abstract
Machine translation quality is highly reliant on large amounts of training data, and, when a limited amount of parallel data is available, synthetic back-translated or multilingual data can be used in addition. In this work, we introduce SynEst, a synthetic corpus of translations from 11 languages into Estonian which totals over 1 billion sentence pairs. Using this corpus, we investigate whether adding synthetic or English-centric additional data yields better translation quality for translation directions that do not include English. Our results show that while both strategies are effective, synthetic data gives better results. Our final models improve the performance of the baseline No Language Left Behind model while retaining its source-side multilinguality.- Anthology ID:
- 2024.lrec-main.1033
- Volume:
- Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
- Month:
- May
- Year:
- 2024
- Address:
- Torino, Italia
- Editors:
- Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
- Venues:
- LREC | COLING
- SIG:
- Publisher:
- ELRA and ICCL
- Note:
- Pages:
- 11838–11848
- Language:
- URL:
- https://aclanthology.org/2024.lrec-main.1033
- DOI:
- Cite (ACL):
- Elizaveta Korotkova, Taido Purason, Agnes Luhtaru, and Mark Fishel. 2024. Multilinguality or Back-translation? A Case Study with Estonian. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 11838–11848, Torino, Italia. ELRA and ICCL.
- Cite (Informal):
- Multilinguality or Back-translation? A Case Study with Estonian (Korotkova et al., LREC-COLING 2024)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-5/2024.lrec-main.1033.pdf