The Herme Database of Spontaneous Multimodal Human-Robot Dialogues

Jing Guang Han, Emer Gilmartin, Celine De Looze, Brian Vaughan, Nick Campbell

Abstract
This paper presents methodologies and tools for language resource (LR) construction. It describes a database of interactive speech collected over a three-month period at the Science Gallery in Dublin, where visitors could take part in a conversation with a robot. The system collected samples of informal, chatty dialogue -- normally difficult to capture under laboratory conditions for human-human dialogue, and particularly so for human-machine interaction. The conversations were based on a script followed by the robot consisting largely of social chat with some task-based elements. The interactions were audio-visually recorded using several cameras together with microphones. As part of the conversation the participants were asked to sign a consent form giving permission to use their data for human-machine interaction research. The multimodal corpus will be made available to interested researchers and the technology developed during the three-month exhibition is being extended for use in education and assisted-living applications.
Anthology ID:
L12-1293
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1328–1331
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/526_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Jing Guang Han, Emer Gilmartin, Celine De Looze, Brian Vaughan, and Nick Campbell. 2012. The Herme Database of Spontaneous Multimodal Human-Robot Dialogues. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 1328–1331, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
The Herme Database of Spontaneous Multimodal Human-Robot Dialogues (Han et al., LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/526_Paper.pdf
PDF Search