Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation

Haiyue Song, Raj Dabre, Atsushi Fujita, Sadao Kurohashi


Abstract
Lectures translation is a case of spoken language translation and there is a lack of publicly available parallel corpora for this purpose. To address this, we examine a framework for parallel corpus mining which is a quick and effective way to mine a parallel corpus from publicly available lectures at Coursera. Our approach determines sentence alignments, relying on machine translation and cosine similarity over continuous-space sentence representations. We also show how to use the resulting corpora in a multistage fine-tuning based domain adaptation for high-quality lectures translation. For Japanese–English lectures translation, we extracted parallel data of approximately 40,000 lines and created development and test sets through manual filtering for benchmarking translation performance. We demonstrate that the mined corpus greatly enhances the quality of translation when used in conjunction with out-of-domain parallel corpora via multistage training. This paper also suggests some guidelines to gather and clean corpora, mine parallel sentences, address noise in the mined data, and create high-quality evaluation splits. For the sake of reproducibility, we have released our code for parallel data creation.
Anthology ID:
2020.lrec-1.449
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
3640–3649
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.449
DOI:
Bibkey:
Cite (ACL):
Haiyue Song, Raj Dabre, Atsushi Fujita, and Sadao Kurohashi. 2020. Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 3640–3649, Marseille, France. European Language Resources Association.
Cite (Informal):
Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation (Song et al., LREC 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp-22-attachments/2020.lrec-1.449.pdf
Code
 shyyhs/CourseraParallelCorpusMining
Data
ASPECC4