Familiar words but strange voices: Modelling the influence of speech variability on word recognition
Abstract
We present a deep neural model of spoken word recognition which is trained to retrieve the meaning of a word (in the form of a word embedding) given its spoken form, a task which resembles that faced by a human listener. Furthermore, we investigate the influence of variability in speech signals on the model’s performance. To this end, we conduct of set of controlled experiments using word-aligned read speech data in German. Our experiments show that (1) the model is more sensitive to dialectical variation than gender variation, and (2) recognition performance of word cognates from related languages reflect the degree of relatedness between languages in our study. Our work highlights the feasibility of modeling human speech perception using deep neural networks.- Anthology ID:
- 2021.eacl-srw.14
- Volume:
- Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop
- Month:
- April
- Year:
- 2021
- Address:
- Online
- Editors:
- Ionut-Teodor Sorodoc, Madhumita Sushil, Ece Takmaz, Eneko Agirre
- Venue:
- EACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 96–102
- Language:
- URL:
- https://aclanthology.org/2021.eacl-srw.14
- DOI:
- 10.18653/v1/2021.eacl-srw.14
- Cite (ACL):
- Alexandra Mayn, Badr M. Abdullah, and Dietrich Klakow. 2021. Familiar words but strange voices: Modelling the influence of speech variability on word recognition. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop, pages 96–102, Online. Association for Computational Linguistics.
- Cite (Informal):
- Familiar words but strange voices: Modelling the influence of speech variability on word recognition (Mayn et al., EACL 2021)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2021.eacl-srw.14.pdf