Controlling Prosody in End-to-End TTS: A Case Study on Contrastive Focus Generation
Siddique Latif, Inyoung Kim, Ioan Calapodescu, Laurent Besacier
Abstract
While End-2-End Text-to-Speech (TTS) has made significant progresses over the past few years, these systems still lack intuitive user controls over prosody. For instance, generating speech with fine-grained prosody control (prosodic prominence, contextually appropriate emotions) is still an open challenge. In this paper, we investigate whether we can control prosody directly from the input text, in order to code information related to contrastive focus which emphasizes a specific word that is contrary to the presuppositions of the interlocutor. We build and share a specific dataset for this purpose and show that it allows to train a TTS system were this fine-grained prosodic feature can be correctly conveyed using control tokens. Our evaluation compares synthetic and natural utterances and shows that prosodic patterns of contrastive focus (variations of Fo, Intensity and Duration) can be learnt accurately. Such a milestone is important to allow, for example, smart speakers to be programmatically controlled in terms of output prosody.- Anthology ID:
- 2021.conll-1.42
- Volume:
- Proceedings of the 25th Conference on Computational Natural Language Learning
- Month:
- November
- Year:
- 2021
- Address:
- Online
- Editors:
- Arianna Bisazza, Omri Abend
- Venue:
- CoNLL
- SIG:
- SIGNLL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 544–551
- Language:
- URL:
- https://aclanthology.org/2021.conll-1.42
- DOI:
- 10.18653/v1/2021.conll-1.42
- Cite (ACL):
- Siddique Latif, Inyoung Kim, Ioan Calapodescu, and Laurent Besacier. 2021. Controlling Prosody in End-to-End TTS: A Case Study on Contrastive Focus Generation. In Proceedings of the 25th Conference on Computational Natural Language Learning, pages 544–551, Online. Association for Computational Linguistics.
- Cite (Informal):
- Controlling Prosody in End-to-End TTS: A Case Study on Contrastive Focus Generation (Latif et al., CoNLL 2021)
- PDF:
- https://preview.aclanthology.org/naacl-24-ws-corrections/2021.conll-1.42.pdf