Feudal Dialogue Management with Jointly Learned Feature Extractors
Iñigo Casanueva, Paweł Budzianowski, Stefan Ultes, Florian Kreyssig, Bo-Hsiang Tseng, Yen-chen Wu, Milica Gašić
Abstract
Reinforcement learning (RL) is a promising dialogue policy optimisation approach, but traditional RL algorithms fail to scale to large domains. Recently, Feudal Dialogue Management (FDM), has shown to increase the scalability to large domains by decomposing the dialogue management decision into two steps, making use of the domain ontology to abstract the dialogue state in each step. In order to abstract the state space, however, previous work on FDM relies on handcrafted feature functions. In this work, we show that these feature functions can be learned jointly with the policy model while obtaining similar performance, even outperforming the handcrafted features in several environments and domains.- Anthology ID:
- W18-5038
- Volume:
- Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue
- Month:
- July
- Year:
- 2018
- Address:
- Melbourne, Australia
- Editors:
- Kazunori Komatani, Diane Litman, Kai Yu, Alex Papangelis, Lawrence Cavedon, Mikio Nakano
- Venue:
- SIGDIAL
- SIG:
- SIGDIAL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 332–337
- Language:
- URL:
- https://aclanthology.org/W18-5038
- DOI:
- 10.18653/v1/W18-5038
- Cite (ACL):
- Iñigo Casanueva, Paweł Budzianowski, Stefan Ultes, Florian Kreyssig, Bo-Hsiang Tseng, Yen-chen Wu, and Milica Gašić. 2018. Feudal Dialogue Management with Jointly Learned Feature Extractors. In Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue, pages 332–337, Melbourne, Australia. Association for Computational Linguistics.
- Cite (Informal):
- Feudal Dialogue Management with Jointly Learned Feature Extractors (Casanueva et al., SIGDIAL 2018)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/W18-5038.pdf