Adapting Descriptions of People to the Point of View of a Moving Observer

Gonzalo Méndez, Raquel Hervás, Pablo Gervás, Ricardo de la Rosa, Daniel Ruiz


Abstract
This paper addresses the task of generating descriptions of people for an observer that is moving within a scene. As the observer moves, the descriptions of the people around him also change. A referring expression generation algorithm adapted to this task needs to continuously monitor the changes in the field of view of the observer, his relative position to the people being described, and the relative position of these people to any landmarks around them, and to take these changes into account in the referring expressions generated. This task presents two advantages: many of the mechanisms already available for static contexts may be applied with small adaptations, and it introduces the concept of changing conditions into the task of referring expression generation. In this paper we describe the design of an algorithm that takes these aspects into account in order to create descriptions of people within a 3D virtual environment. The evaluation of this algorithm has shown that, by changing the descriptions in real time according to the observers point of view, they are able to identify the described person quickly and effectively.
Anthology ID:
W18-6540
Volume:
Proceedings of the 11th International Conference on Natural Language Generation
Month:
November
Year:
2018
Address:
Tilburg University, The Netherlands
Editors:
Emiel Krahmer, Albert Gatt, Martijn Goudbeek
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
329–338
Language:
URL:
https://aclanthology.org/W18-6540
DOI:
10.18653/v1/W18-6540
Bibkey:
Cite (ACL):
Gonzalo Méndez, Raquel Hervás, Pablo Gervás, Ricardo de la Rosa, and Daniel Ruiz. 2018. Adapting Descriptions of People to the Point of View of a Moving Observer. In Proceedings of the 11th International Conference on Natural Language Generation, pages 329–338, Tilburg University, The Netherlands. Association for Computational Linguistics.
Cite (Informal):
Adapting Descriptions of People to the Point of View of a Moving Observer (Méndez et al., INLG 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-2/W18-6540.pdf