Personalized Search-based Query Rewrite System for Conversational AI

Eunah Cho, Ziyan Jiang, Jie Hao, Zheng Chen, Saurabh Gupta, Xing Fan, Chenlei Guo

Abstract
Query rewrite (QR) is an emerging component in conversational AI systems, reducing user defect. User defect is caused by various reasons, such as errors in the spoken dialogue system, users’ slips of the tongue or their abridged language. Many of the user defects stem from personalized factors, such as user’s speech pattern, dialect, or preferences. In this work, we propose a personalized search-based QR framework, which focuses on automatic reduction of user defect. We build a personalized index for each user, which encompasses diverse affinity layers to reflect personal preferences for each user in the conversational AI. Our personalized QR system contains retrieval and ranking layers. Supported by user feedback based learning, training our models does not require hand-annotated data. Experiments on personalized test set showed that our personalized QR system is able to correct systematic and user errors by utilizing phonetic and semantic inputs.
Anthology ID:
2021.nlp4convai-1.17
Volume:
Proceedings of the 3rd Workshop on Natural Language Processing for Conversational AI
Month:
November
Year:
2021
Address:
Online
Venue:
NLP4ConvAI
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
179–188
Language:
URL:
https://aclanthology.org/2021.nlp4convai-1.17
DOI:
10.18653/v1/2021.nlp4convai-1.17
Bibkey:
Cite (ACL):
Eunah Cho, Ziyan Jiang, Jie Hao, Zheng Chen, Saurabh Gupta, Xing Fan, and Chenlei Guo. 2021. Personalized Search-based Query Rewrite System for Conversational AI. In Proceedings of the 3rd Workshop on Natural Language Processing for Conversational AI, pages 179–188, Online. Association for Computational Linguistics.
Cite (Informal):
Personalized Search-based Query Rewrite System for Conversational AI (Cho et al., NLP4ConvAI 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/2021.nlp4convai-1.17.pdf
Video:
 https://preview.aclanthology.org/ingestion-script-update/2021.nlp4convai-1.17.mp4
PDF Search Video