Using Gestures to Resolve Lexical Ambiguity in Storytelling with Humanoid Robots

Catelyn Scholl, Susan McRoy


Abstract
Gestures that co-occur with speech are a fundamental component of communication. Prior research with children suggests that gestures may help them to resolve certain forms of lexical ambiguity, including homophones. To test this idea in the context of human-robot interaction, the effects of iconic and deictic gestures on the understanding of homophones was assessed in an experiment where a humanoid robot told a short story containing pairs of homophones to small groups of young participants, accompanied by either expressive gestures or no gestures. Both groups of subjects completed a pretest and post-test to measure their ability to discriminate between pairs of homophones and we calculated aggregated precision. The results show that the use of iconic and deictic gestures aids in general understanding of homophones, providing additional evidence for the importance of gesture to the development of children’s language and communication skills.
Anthology ID:
2019.dnd-10.7
Volume:
Dialogue Discourse Volume 10
Month:
Year:
2019
Address:
Editors:
Vera Demberg, Manfred Stede, Barbara Di Eugenio, Maite Taboada, Patrick Healey
Venue:
DND
SIG:
SIGDIAL
Publisher:
Note:
Pages:
20–33
Language:
URL:
https://preview.aclanthology.org/ingest-dnd/2019.dnd-10.7/
DOI:
10.5087/dad.2019.102
Bibkey:
Cite (ACL):
Catelyn Scholl and Susan McRoy. 2019. Using Gestures to Resolve Lexical Ambiguity in Storytelling with Humanoid Robots. Dialogue & Discourse, 10:20–33.
Cite (Informal):
Using Gestures to Resolve Lexical Ambiguity in Storytelling with Humanoid Robots (Scholl & McRoy, DND 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-dnd/2019.dnd-10.7.pdf