Autonomous Sub-domain Modeling for Dialogue Policy with Hierarchical Deep Reinforcement Learning
Giovanni Yoko Kristianto, Huiwen Zhang, Bin Tong, Makoto Iwayama, Yoshiyuki Kobayashi
Abstract
Solving composites tasks, which consist of several inherent sub-tasks, remains a challenge in the research area of dialogue. Current studies have tackled this issue by manually decomposing the composite tasks into several sub-domains. However, much human effort is inevitable. This paper proposes a dialogue framework that autonomously models meaningful sub-domains and learns the policy over them. Our experiments show that our framework outperforms the baseline without subdomains by 11% in terms of success rate, and is competitive with that with manually defined sub-domains.- Anthology ID:
- W18-5702
- Volume:
- Proceedings of the 2018 EMNLP Workshop SCAI: The 2nd International Workshop on Search-Oriented Conversational AI
- Month:
- October
- Year:
- 2018
- Address:
- Brussels, Belgium
- Editors:
- Aleksandr Chuklin, Jeff Dalton, Julia Kiseleva, Alexey Borisov, Mikhail Burtsev
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 9–16
- Language:
- URL:
- https://aclanthology.org/W18-5702
- DOI:
- 10.18653/v1/W18-5702
- Cite (ACL):
- Giovanni Yoko Kristianto, Huiwen Zhang, Bin Tong, Makoto Iwayama, and Yoshiyuki Kobayashi. 2018. Autonomous Sub-domain Modeling for Dialogue Policy with Hierarchical Deep Reinforcement Learning. In Proceedings of the 2018 EMNLP Workshop SCAI: The 2nd International Workshop on Search-Oriented Conversational AI, pages 9–16, Brussels, Belgium. Association for Computational Linguistics.
- Cite (Informal):
- Autonomous Sub-domain Modeling for Dialogue Policy with Hierarchical Deep Reinforcement Learning (Kristianto et al., EMNLP 2018)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-1/W18-5702.pdf