Abstract
Intelligent assistants (IAs) such as Siri and Cortana conversationally interact with users and execute a wide range of actions (e.g., searching the Web, setting alarms, and chatting). IAs can support these actions through the combination of various components such as automatic speech recognition, natural language understanding, and language generation. However, the complexity of these components hinders developers from determining which component causes an error. To remove this hindrance, we focus on reformulation, which is a useful signal of user dissatisfaction, and propose a method to predict the reformulation causes. We evaluate the method using the user logs of a commercial IA. The experimental results have demonstrated that features designed to detect the error of a specific component improve the performance of reformulation cause detection.- Anthology ID:
- W17-5536
- Volume:
- Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue
- Month:
- August
- Year:
- 2017
- Address:
- Saarbrücken, Germany
- Editors:
- Kristiina Jokinen, Manfred Stede, David DeVault, Annie Louis
- Venue:
- SIGDIAL
- SIG:
- SIGDIAL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 299–309
- Language:
- URL:
- https://aclanthology.org/W17-5536
- DOI:
- 10.18653/v1/W17-5536
- Cite (ACL):
- Shumpei Sano, Nobuhiro Kaji, and Manabu Sassano. 2017. Predicting Causes of Reformulation in Intelligent Assistants. In Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue, pages 299–309, Saarbrücken, Germany. Association for Computational Linguistics.
- Cite (Informal):
- Predicting Causes of Reformulation in Intelligent Assistants (Sano et al., SIGDIAL 2017)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/W17-5536.pdf