Abstract
Building a robust machine translation (MT) system requires a large amount of parallel corpus which is an expensive resource for low-resourced languages. The two major languages being spoken in the Philippines which are Filipino and Cebuano have an abundance in monolingual data that this study took advantage of attempting to find the best way to automatically generate parallel corpus out from monolingual corpora through the use of bitext alignment. Byte-pair encoding was applied in an attempt to optimize the alignment of the source and target texts. Results have shown that alignment was best achieved without segmenting the tokens. Itermax alignment score is best for short-length sentences and match or argmax alignment score are best for long-length sentences.- Anthology ID:
- 2022.loresmt-1.13
- Volume:
- Proceedings of the Fifth Workshop on Technologies for Machine Translation of Low-Resource Languages (LoResMT 2022)
- Month:
- October
- Year:
- 2022
- Address:
- Gyeongju, Republic of Korea
- Editors:
- Atul Kr. Ojha, Chao-Hong Liu, Ekaterina Vylomova, Jade Abbott, Jonathan Washington, Nathaniel Oco, Tommi A Pirinen, Valentin Malykh, Varvara Logacheva, Xiaobing Zhao
- Venue:
- LoResMT
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 99–106
- Language:
- URL:
- https://aclanthology.org/2022.loresmt-1.13
- DOI:
- Cite (ACL):
- Jenn Leana Fernandez and Kristine Mae M. Adlaon. 2022. Exploring Word Alignment towards an Efficient Sentence Aligner for Filipino and Cebuano Languages. In Proceedings of the Fifth Workshop on Technologies for Machine Translation of Low-Resource Languages (LoResMT 2022), pages 99–106, Gyeongju, Republic of Korea. Association for Computational Linguistics.
- Cite (Informal):
- Exploring Word Alignment towards an Efficient Sentence Aligner for Filipino and Cebuano Languages (Fernandez & Adlaon, LoResMT 2022)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2022.loresmt-1.13.pdf