Dialogue Policies for Learning Board Games through Multimodal Communication
Maryam Zare, Ali Ayub, Aishan Liu, Sweekar Sudhakara, Alan Wagner, Rebecca Passonneau
Abstract
This paper presents MDP policy learning for agents to learn strategic behavior–how to play board games–during multimodal dialogues. Policies are trained offline in simulation, with dialogues carried out in a formal language. The agent has a temporary belief state for the dialogue, and a persistent knowledge store represented as an extensive-form game tree. How well the agent learns a new game from a dialogue with a simulated partner is evaluated by how well it plays the game, given its dialogue-final knowledge state. During policy training, we control for the simulated dialogue partner’s level of informativeness in responding to questions. The agent learns best when its trained policy matches the current dialogue partner’s informativeness. We also present a novel data collection for training natural language modules. Human subjects who engaged in dialogues with a baseline system rated the system’s language skills as above average. Further, results confirm that human dialogue partners also vary in their informativeness.- Anthology ID:
- 2020.sigdial-1.41
- Volume:
- Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue
- Month:
- July
- Year:
- 2020
- Address:
- 1st virtual meeting
- Editors:
- Olivier Pietquin, Smaranda Muresan, Vivian Chen, Casey Kennington, David Vandyke, Nina Dethlefs, Koji Inoue, Erik Ekstedt, Stefan Ultes
- Venue:
- SIGDIAL
- SIG:
- SIGDIAL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 339–351
- Language:
- URL:
- https://aclanthology.org/2020.sigdial-1.41
- DOI:
- 10.18653/v1/2020.sigdial-1.41
- Cite (ACL):
- Maryam Zare, Ali Ayub, Aishan Liu, Sweekar Sudhakara, Alan Wagner, and Rebecca Passonneau. 2020. Dialogue Policies for Learning Board Games through Multimodal Communication. In Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 339–351, 1st virtual meeting. Association for Computational Linguistics.
- Cite (Informal):
- Dialogue Policies for Learning Board Games through Multimodal Communication (Zare et al., SIGDIAL 2020)
- PDF:
- https://preview.aclanthology.org/emnlp22-frontmatter/2020.sigdial-1.41.pdf