Attentive fine-tuning of Transformers for Translation of low-resourced languages @LoResMT 2021
Karthik Puranik, Adeep Hande, Ruba Priyadharshini, Thenmozi Durairaj, Anbukkarasi Sampath, Kingston Pal Thamburaj, Bharathi Raja Chakravarthi
Abstract
This paper reports the Machine Translation (MT) systems submitted by the IIITT team for the English→Marathi and English⇔Irish language pairs LoResMT 2021 shared task. The task focuses on getting exceptional translations for rather low-resourced languages like Irish and Marathi. We fine-tune IndicTrans, a pretrained multilingual NMT model for English→Marathi, using external parallel corpus as input for additional training. We have used a pretrained Helsinki-NLP Opus MT English⇔Irish model for the latter language pair. Our approaches yield relatively promising results on the BLEU metrics. Under the team name IIITT, our systems ranked 1, 1, and 2 in English→Marathi, Irish→English, and English→Irish respectively. The codes for our systems are published1 .- Anthology ID:
- 2021.mtsummit-loresmt.14
- Volume:
- Proceedings of the 4th Workshop on Technologies for MT of Low Resource Languages (LoResMT2021)
- Month:
- August
- Year:
- 2021
- Address:
- Virtual
- Venue:
- LoResMT
- SIG:
- Publisher:
- Association for Machine Translation in the Americas
- Note:
- Pages:
- 134–143
- Language:
- URL:
- https://aclanthology.org/2021.mtsummit-loresmt.14
- DOI:
- Cite (ACL):
- Karthik Puranik, Adeep Hande, Ruba Priyadharshini, Thenmozi Durairaj, Anbukkarasi Sampath, Kingston Pal Thamburaj, and Bharathi Raja Chakravarthi. 2021. Attentive fine-tuning of Transformers for Translation of low-resourced languages @LoResMT 2021. In Proceedings of the 4th Workshop on Technologies for MT of Low Resource Languages (LoResMT2021), pages 134–143, Virtual. Association for Machine Translation in the Americas.
- Cite (Informal):
- Attentive fine-tuning of Transformers for Translation of low-resourced languages @LoResMT 2021 (Puranik et al., LoResMT 2021)
- PDF:
- https://preview.aclanthology.org/ingestion-script-update/2021.mtsummit-loresmt.14.pdf
- Code
- karthikpuranik11/loresmt