Data Collection for Empirically Determining the Necessary Information for Smooth Handover in Dialogue

Sanae Yamashita, Ryuichiro Higashinaka


Abstract
Despite recent advances, dialogue systems still struggle to achieve fully autonomous transactions. Therefore, when a system encounters a problem, human operators need to take over the dialogue to complete the transaction. However, it is unclear what information should be presented to the operator when this handover takes place. In this study, we conducted a data collection experiment in which one of two operators talked to a user and switched with the other operator periodically while exchanging notes when the handovers took place. By examining these notes, it is possible to identify the information necessary for handing over the dialogue. We collected 60 dialogues in which two operators switched periodically while performing chat, consultation, and sales tasks in dialogue. We found that adjacency pairs are a useful representation for recording conversation history. In addition, we found that key-value-pair representation is also useful when there are underlying tasks, such as consultation and sales.
Anthology ID:
2022.lrec-1.432
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
4060–4068
Language:
URL:
https://aclanthology.org/2022.lrec-1.432
DOI:
Bibkey:
Cite (ACL):
Sanae Yamashita and Ryuichiro Higashinaka. 2022. Data Collection for Empirically Determining the Necessary Information for Smooth Handover in Dialogue. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 4060–4068, Marseille, France. European Language Resources Association.
Cite (Informal):
Data Collection for Empirically Determining the Necessary Information for Smooth Handover in Dialogue (Yamashita & Higashinaka, LREC 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/naacl24-info/2022.lrec-1.432.pdf