End-to-End Automatic Speech Recognition: Its Impact on the Workflowin Documenting Yoloxóchitl Mixtec

Jonathan D. Amith, Jiatong Shi, Rey Castillo García

Abstract
This paper describes three open access Yoloxóchitl Mixtec corpora and presents the results and implications of end-to-end automatic speech recognition for endangered language documentation. Two issues are addressed. First, the advantage for ASR accuracy of targeting informational (BPE) units in addition to, or in substitution of, linguistic units (word, morpheme, morae) and then using ROVER for system combination. BPE units consistently outperform linguistic units although the best results are obtained by system combination of different BPE targets. Second, a case is made that for endangered language documentation, ASR contributions should be evaluated according to extrinsic criteria (e.g., positive impact on downstream tasks) and not simply intrinsic metrics (e.g., CER and WER). The extrinsic metric chosen is the level of reduction in the human effort needed to produce high-quality transcriptions for permanent archiving.
Anthology ID:
2021.americasnlp-1.8
Volume:
Proceedings of the First Workshop on Natural Language Processing for Indigenous Languages of the Americas
Month:
June
Year:
2021
Address:
Online
Venue:
AmericasNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
64–80
Language:
URL:
https://aclanthology.org/2021.americasnlp-1.8
DOI:
10.18653/v1/2021.americasnlp-1.8
Bibkey:
Cite (ACL):
Jonathan D. Amith, Jiatong Shi, and Rey Castillo García. 2021. End-to-End Automatic Speech Recognition: Its Impact on the Workflowin Documenting Yoloxóchitl Mixtec. In Proceedings of the First Workshop on Natural Language Processing for Indigenous Languages of the Americas, pages 64–80, Online. Association for Computational Linguistics.
Cite (Informal):
End-to-End Automatic Speech Recognition: Its Impact on the Workflowin Documenting Yoloxóchitl Mixtec (Amith et al., AmericasNLP 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/auto-file-uploads/2021.americasnlp-1.8.pdf
PDF Search