Semiautomatic Speech Alignment for Under-Resourced Languages

Juho Leinonen, Niko Partanen, Sami Virpioja, Mikko Kurimo


Abstract
Cross-language forced alignment is a solution for linguists who create speech corpora for very low-resource languages. However, cross-language is an additional challenge making a complex task, forced alignment, even more difficult. We study how linguists can impart domain expertise to the tasks to increase the performance of automatic forced aligners while keeping the time effort still lower than with manual forced alignment. First, we show that speech recognizers have a clear bias in starting the word later than a human annotator, which results in micro-pauses in the results that do not exist in manual alignments, and study which is the best way to automatically remove these silences. Second, we ask the linguists to simplify the task by splitting long interview audios into shorter lengths by providing some manually aligned segments and evaluating the results of this process. We also study how correlated source language performance is to target language performance, since often it is an easier task to find a better source model than to adapt to the target language.
Anthology ID:
2022.eurali-1.3
Volume:
Proceedings of the Workshop on Resources and Technologies for Indigenous, Endangered and Lesser-resourced Languages in Eurasia within the 13th Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Atul Kr. Ojha, Sina Ahmadi, Chao-Hong Liu, John P. McCrae
Venue:
EURALI
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
17–21
Language:
URL:
https://preview.aclanthology.org/build-pipeline-with-new-library/2022.eurali-1.3/
DOI:
Bibkey:
Cite (ACL):
Juho Leinonen, Niko Partanen, Sami Virpioja, and Mikko Kurimo. 2022. Semiautomatic Speech Alignment for Under-Resourced Languages. In Proceedings of the Workshop on Resources and Technologies for Indigenous, Endangered and Lesser-resourced Languages in Eurasia within the 13th Language Resources and Evaluation Conference, pages 17–21, Marseille, France. European Language Resources Association.
Cite (Informal):
Semiautomatic Speech Alignment for Under-Resourced Languages (Leinonen et al., EURALI 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/build-pipeline-with-new-library/2022.eurali-1.3.pdf