Dialog Flow Induction for Constrainable LLM-Based Chatbots
Stuti Agrawal, Pranav Pillai, Nishi Uppuluri, Revanth Gangi Reddy, Sha Li, Gokhan Tur, Dilek Hakkani-Tur, Heng Ji
Abstract
LLM-driven dialog systems are used in a diverse set of applications, ranging from healthcare to customer service. However, given their generalization capability, it is difficult to ensure that these chatbots stay within the boundaries of the specialized domains, potentially resulting in inaccurate information and irrelevant responses. This paper introduces an unsupervised approach for automatically inducing domain-specific dialog flows that can be used to constrain LLM-based chatbots. We introduce two variants of dialog flow based on the availability of in-domain conversation instances. Through human and automatic evaluation over 24 dialog domains, we demonstrate that our high-quality data-guided dialog flows achieve better domain coverage, thereby overcoming the need for extensive manual crafting of such flows.- Anthology ID:
- 2024.sigdial-1.6
- Volume:
- Proceedings of the 25th Annual Meeting of the Special Interest Group on Discourse and Dialogue
- Month:
- September
- Year:
- 2024
- Address:
- Kyoto, Japan
- Editors:
- Tatsuya Kawahara, Vera Demberg, Stefan Ultes, Koji Inoue, Shikib Mehri, David Howcroft, Kazunori Komatani
- Venue:
- SIGDIAL
- SIG:
- SIGDIAL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 66–77
- Language:
- URL:
- https://preview.aclanthology.org/fix-sig-urls/2024.sigdial-1.6/
- DOI:
- 10.18653/v1/2024.sigdial-1.6
- Cite (ACL):
- Stuti Agrawal, Pranav Pillai, Nishi Uppuluri, Revanth Gangi Reddy, Sha Li, Gokhan Tur, Dilek Hakkani-Tur, and Heng Ji. 2024. Dialog Flow Induction for Constrainable LLM-Based Chatbots. In Proceedings of the 25th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 66–77, Kyoto, Japan. Association for Computational Linguistics.
- Cite (Informal):
- Dialog Flow Induction for Constrainable LLM-Based Chatbots (Agrawal et al., SIGDIAL 2024)
- PDF:
- https://preview.aclanthology.org/fix-sig-urls/2024.sigdial-1.6.pdf