Extending the Wizard of Oz Methodologie for Multimodal Language-enabled Systems

Martin Rajman, Marita Ailomaa, Agnes Lisowska, Miroslav Melichar, Susan Armstrong

Abstract
In this paper we present a proposal for extending the standard Wizard of Oz experimental methodology to language-enabled multimodal systems. We first discuss how Wizard of Oz experiments involving multimodal systems differ from those involving voice-only systems. We then go on to discuss the Extended Wizard of Oz methodology and the Wizard of Oz testing environment and protocol that we have developed. We then describe an example of applying this methodology to Archivus, a multimodal system for multimedia meeting retrieval and browsing. We focus in particular on the tools that the wizards would need to successfully and efficiently perform their tasks in a multimodal context. We conclude with some general comments about which questions need to be addressed when developing and using the Wizard of Oz methodology for testing multimodal systems.
Anthology ID:
L06-1189
Volume:
Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06)
Month:
May
Year:
2006
Address:
Genoa, Italy
Editors:
Nicoletta Calzolari, Khalid Choukri, Aldo Gangemi, Bente Maegaard, Joseph Mariani, Jan Odijk, Daniel Tapias
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2006/pdf/328_pdf.pdf
DOI:
Bibkey:
Cite (ACL):
Martin Rajman, Marita Ailomaa, Agnes Lisowska, Miroslav Melichar, and Susan Armstrong. 2006. Extending the Wizard of Oz Methodologie for Multimodal Language-enabled Systems. In Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06), Genoa, Italy. European Language Resources Association (ELRA).
Cite (Informal):
Extending the Wizard of Oz Methodologie for Multimodal Language-enabled Systems (Rajman et al., LREC 2006)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2006/pdf/328_pdf.pdf
PDF Search