The Herme Database of Spontaneous Multimodal Human-Robot Dialogues
Jing Guang Han, Emer Gilmartin, Celine De Looze, Brian Vaughan, Nick Campbell
Abstract
This paper presents methodologies and tools for language resource (LR) construction. It describes a database of interactive speech collected over a three-month period at the Science Gallery in Dublin, where visitors could take part in a conversation with a robot. The system collected samples of informal, chatty dialogue -- normally difficult to capture under laboratory conditions for human-human dialogue, and particularly so for human-machine interaction. The conversations were based on a script followed by the robot consisting largely of social chat with some task-based elements. The interactions were audio-visually recorded using several cameras together with microphones. As part of the conversation the participants were asked to sign a consent form giving permission to use their data for human-machine interaction research. The multimodal corpus will be made available to interested researchers and the technology developed during the three-month exhibition is being extended for use in education and assisted-living applications.- Anthology ID:
- L12-1293
- Volume:
- Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
- Month:
- May
- Year:
- 2012
- Address:
- Istanbul, Turkey
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 1328–1331
- Language:
- URL:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/526_Paper.pdf
- DOI:
- Cite (ACL):
- Jing Guang Han, Emer Gilmartin, Celine De Looze, Brian Vaughan, and Nick Campbell. 2012. The Herme Database of Spontaneous Multimodal Human-Robot Dialogues. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 1328–1331, Istanbul, Turkey. European Language Resources Association (ELRA).
- Cite (Informal):
- The Herme Database of Spontaneous Multimodal Human-Robot Dialogues (Han et al., LREC 2012)
- PDF:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/526_Paper.pdf