Chat-crowd: A Dialog-based Platform for Visual Layout Composition

Paola Cascante-Bonilla, Xuwang Yin, Vicente Ordonez, Song Feng

Abstract
In this paper we introduce Chat-crowd, an interactive environment for visual layout composition via conversational interactions. Chat-crowd supports multiple agents with two conversational roles: agents who play the role of a designer are in charge of placing objects in an editable canvas according to instructions or commands issued by agents with a director role. The system can be integrated with crowdsourcing platforms for both synchronous and asynchronous data collection and is equipped with comprehensive quality controls on the performance of both types of agents. We expect that this system will be useful to build multimodal goal-oriented dialog tasks that require spatial and geometric reasoning.
Anthology ID:
N19-4024
Volume:
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations)
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota
Editors:
Waleed Ammar, Annie Louis, Nasrin Mostafazadeh
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
138–142
Language:
URL:
https://aclanthology.org/N19-4024
DOI:
10.18653/v1/N19-4024
Bibkey:
Cite (ACL):
Paola Cascante-Bonilla, Xuwang Yin, Vicente Ordonez, and Song Feng. 2019. Chat-crowd: A Dialog-based Platform for Visual Layout Composition. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations), pages 138–142, Minneapolis, Minnesota. Association for Computational Linguistics.
Cite (Informal):
Chat-crowd: A Dialog-based Platform for Visual Layout Composition (Cascante-Bonilla et al., NAACL 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-1/N19-4024.pdf
Data
MS COCO, SHAPES
PDF Search