Abstract
We investigate the performance of state-of-the-art neural ASR systems in transcribing audio recordings for Hupa, a critically endangered language of the Hoopa Valley Tribe. We also explore the impact on ASR performance when augmenting a small dataset of gold-standard high-quality transcriptions with a) a larger dataset with transcriptions of lower quality, and b) model-generated transcriptions in a self-training approach. An evaluation of both data augmentation approaches shows that the self-training approach is competitive, producing better WER scores than models trained with no additional data and not lagging far behind models trained with additional lower quality manual transcriptions instead: the deterioration in WER score is just 4.85 points when all the additional data is used in experiments with the best performing system, Wav2Vec. These findings have encouraging implications on the use of ASR systems for transcription and language documentation efforts in the Hupa language.- Anthology ID:
- 2024.computel-1.9
- Volume:
- Proceedings of the Seventh Workshop on the Use of Computational Methods in the Study of Endangered Languages
- Month:
- March
- Year:
- 2024
- Address:
- St. Julians, Malta
- Editors:
- Sarah Moeller, Godfred Agyapong, Antti Arppe, Aditi Chaudhary, Shruti Rijhwani, Christopher Cox, Ryan Henke, Alexis Palmer, Daisy Rosenblum, Lane Schwartz
- Venues:
- ComputEL | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 58–66
- Language:
- URL:
- https://aclanthology.org/2024.computel-1.9
- DOI:
- Cite (ACL):
- Nitin Venkateswaran and Zoey Liu. 2024. Looking within the self: Investigating the Impact of Data Augmentation with Self-training on Automatic Speech Recognition for Hupa. In Proceedings of the Seventh Workshop on the Use of Computational Methods in the Study of Endangered Languages, pages 58–66, St. Julians, Malta. Association for Computational Linguistics.
- Cite (Informal):
- Looking within the self: Investigating the Impact of Data Augmentation with Self-training on Automatic Speech Recognition for Hupa (Venkateswaran & Liu, ComputEL-WS 2024)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2024.computel-1.9.pdf