“What do others think?”: Task-Oriented Conversational Modeling with Subjective Knowledge
Chao Zhao, Spandana Gella, Seokhwan Kim, Di Jin, Devamanyu Hazarika, Alexandros Papangelis, Behnam Hedayatnia, Mahdi Namazifar, Yang Liu, Dilek Hakkani-Tur
Abstract
Task-oriented Dialogue (TOD) Systems aim to build dialogue systems that assist users in accomplishing specific goals, such as booking a hotel or a restaurant. Traditional TODs rely on domain-specific APIs/DBs or external factual knowledge to generate responses, which cannot accommodate subjective user requests (e.g.,”Is the WIFI reliable?” or “Does the restaurant have a good atmosphere?”). To address this issue, we propose a novel task of subjective-knowledge-based TOD (SK-TOD). We also propose the first corresponding dataset, which contains subjective knowledge-seeking dialogue contexts and manually annotated responses grounded in subjective knowledge sources. When evaluated with existing TOD approaches, we find that this task poses new challenges such as aggregating diverse opinions from multiple knowledge snippets. We hope this task and dataset can promote further research on TOD and subjective content understanding. The code and the dataset are available at https://github.com/alexa/dstc11-track5.- Anthology ID:
- 2023.sigdial-1.28
- Volume:
- Proceedings of the 24th Annual Meeting of the Special Interest Group on Discourse and Dialogue
- Month:
- September
- Year:
- 2023
- Address:
- Prague, Czechia
- Editors:
- Svetlana Stoyanchev, Shafiq Joty, David Schlangen, Ondrej Dusek, Casey Kennington, Malihe Alikhani
- Venue:
- SIGDIAL
- SIG:
- SIGDIAL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 309–323
- Language:
- URL:
- https://aclanthology.org/2023.sigdial-1.28
- DOI:
- 10.18653/v1/2023.sigdial-1.28
- Cite (ACL):
- Chao Zhao, Spandana Gella, Seokhwan Kim, Di Jin, Devamanyu Hazarika, Alexandros Papangelis, Behnam Hedayatnia, Mahdi Namazifar, Yang Liu, and Dilek Hakkani-Tur. 2023. “What do others think?”: Task-Oriented Conversational Modeling with Subjective Knowledge. In Proceedings of the 24th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 309–323, Prague, Czechia. Association for Computational Linguistics.
- Cite (Informal):
- “What do others think?”: Task-Oriented Conversational Modeling with Subjective Knowledge (Zhao et al., SIGDIAL 2023)
- PDF:
- https://preview.aclanthology.org/emnlp22-frontmatter/2023.sigdial-1.28.pdf