Abstract
In multimodal natural language interaction both speech and non-speech gestures are involved in the basic mechanism of grounding and repair. We discuss a couple of multimodal clarifica- tion requests and argue that gestures, as well as speech expressions, underlie comparable paral- lelism constraints. In order to make this precise, we slightly extend the formal dialogue frame- work KoS to cover also gestural counterparts of verbal locutionary propositions.- Anthology ID:
- 2021.mmsr-1.3
- Volume:
- Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR)
- Month:
- June
- Year:
- 2021
- Address:
- Groningen, Netherlands (Online)
- Editors:
- Lucia Donatelli, Nikhil Krishnaswamy, Kenneth Lai, James Pustejovsky
- Venue:
- MMSR
- SIG:
- SIGSEM
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 21–31
- Language:
- URL:
- https://aclanthology.org/2021.mmsr-1.3
- DOI:
- Cite (ACL):
- Jonathan Ginzburg and Andy Luecking. 2021. Requesting clarifications with speech and gestures. In Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR), pages 21–31, Groningen, Netherlands (Online). Association for Computational Linguistics.
- Cite (Informal):
- Requesting clarifications with speech and gestures (Ginzburg & Luecking, MMSR 2021)
- PDF:
- https://preview.aclanthology.org/ml4al-ingestion/2021.mmsr-1.3.pdf