A joint intelligibility evaluation of French text-to-speech synthesis systems: the EvaSy SUS/ACR campaign

Philippe Boula de Mareüil, Christophe d’Alessandro, Alexander Raake, Gérard Bailly, Marie-Neige Garcia, Michel Morel

Abstract
The EVALDA/EvaSy project is dedicated to the evaluation of text-to-speech synthesis systems for the French language. It is subdivided into four components: evaluation of the grapheme-to-phoneme conversion module (Boula de Mareüil et al., 2005), evaluation of prosody (Garcia et al., 2006), evaluation of intelligibility, and global evaluation of the quality of the synthesised speech. This paper reports on the key results of the intelligibility and global evaluation of the synthesised speech. It focuses on intelligibility, assessed on the basis of semantically unpredictable sentences, but a comparison with absolute category rating in terms of e.g. pleasantness and naturalness is also provided. Three diphone systems and three selection systems have been evaluated. It turns out that the most intelligible system (diphone-based) is far from being the one which obtains the best mean opinion score.
Anthology ID:
L06-1441
Volume:
Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06)
Month:
May
Year:
2006
Address:
Genoa, Italy
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2006/pdf/709_pdf.pdf
DOI:
Bibkey:
Cite (ACL):
Philippe Boula de Mareüil, Christophe d’Alessandro, Alexander Raake, Gérard Bailly, Marie-Neige Garcia, and Michel Morel. 2006. A joint intelligibility evaluation of French text-to-speech synthesis systems: the EvaSy SUS/ACR campaign. In Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06), Genoa, Italy. European Language Resources Association (ELRA).
Cite (Informal):
A joint intelligibility evaluation of French text-to-speech synthesis systems: the EvaSy SUS/ACR campaign (de Mareüil et al., LREC 2006)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2006/pdf/709_pdf.pdf
PDF Search