Bootstrapping a Conversational Guide for Colonoscopy Prep
Pulkit Arya, Madeleine Bloomquist, Subhankar Chakraborty, Andrew Perrault, William Schuler, Eric Fosler-Lussier, Michael White
Abstract
Creating conversational systems for niche domains is a challenging task, further exacerbated by a lack of quality datasets. We explore the construction of safer conversational systems for guiding patients in preparing for colonoscopies. This has required a data generation pipeline to generate a minimum viable dataset to bootstrap a semantic parser, augmented by automatic paraphrasing. Our study suggests large language models (e.g., GPT-3.5 and GPT-4) are a viable alternative to crowd sourced paraphrasing, but conversational systems that rely upon language models’ ability to do temporal reasoning struggle to provide accurate responses. A neural-symbolic system that performs temporal reasoning on an intermediate representation of user queries shows promising results compared to an end-to-end dialogue system, improving the number of correct responses while vastly reducing the number of incorrect or misleading ones.- Anthology ID:
- 2023.sigdial-1.38
- Volume:
- Proceedings of the 24th Annual Meeting of the Special Interest Group on Discourse and Dialogue
- Month:
- September
- Year:
- 2023
- Address:
- Prague, Czechia
- Editors:
- Svetlana Stoyanchev, Shafiq Joty, David Schlangen, Ondrej Dusek, Casey Kennington, Malihe Alikhani
- Venue:
- SIGDIAL
- SIG:
- SIGDIAL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 413–420
- Language:
- URL:
- https://aclanthology.org/2023.sigdial-1.38
- DOI:
- 10.18653/v1/2023.sigdial-1.38
- Cite (ACL):
- Pulkit Arya, Madeleine Bloomquist, Subhankar Chakraborty, Andrew Perrault, William Schuler, Eric Fosler-Lussier, and Michael White. 2023. Bootstrapping a Conversational Guide for Colonoscopy Prep. In Proceedings of the 24th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 413–420, Prague, Czechia. Association for Computational Linguistics.
- Cite (Informal):
- Bootstrapping a Conversational Guide for Colonoscopy Prep (Arya et al., SIGDIAL 2023)
- PDF:
- https://preview.aclanthology.org/teach-a-man-to-fish/2023.sigdial-1.38.pdf