Abstract
Most Text to Speech (TTS) systems today assume that the input text is in a single language and is written in the same language that the text needs to be synthesized in. However, in bilingual and multilingual communities, code mixing or code switching occurs in speech, in which speakers switch between languages in the same utterance. Due to the popularity of social media, we now see code-mixing even in text in these multilingual communities. TTS systems capable of synthesizing such text need to be able to handle text that is written in multiple languages and scripts. Code-mixed text poses many challenges to TTS systems, such as language identification, spelling normalization and pronunciation modeling. In this work, we describe a preliminary framework for synthesizing code-mixed text. We carry out experiments on synthesizing code-mixed Hindi and English text. We find that there is a significant user preference for TTS systems that can correctly identify and pronounce words in different languages.- Anthology ID:
- L16-1546
- Volume:
- Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
- Month:
- May
- Year:
- 2016
- Address:
- Portorož, Slovenia
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 3422–3428
- Language:
- URL:
- https://aclanthology.org/L16-1546
- DOI:
- Cite (ACL):
- Sunayana Sitaram and Alan W Black. 2016. Speech Synthesis of Code-Mixed Text. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 3422–3428, Portorož, Slovenia. European Language Resources Association (ELRA).
- Cite (Informal):
- Speech Synthesis of Code-Mixed Text (Sitaram & Black, LREC 2016)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/L16-1546.pdf