Response Generation in Longitudinal Dialogues: Which Knowledge Representation Helps?

Seyed Mahed Mousavi, Simone Caldarella, Giuseppe Riccardi


Abstract
Longitudinal Dialogues (LD) are the most challenging type of conversation for human-machine dialogue systems. LDs include the recollections of events, personal thoughts, and emotions specific to each individual in a sparse sequence of dialogue sessions. Dialogue systems designed for LDs should uniquely interact with the users over multiple sessions and long periods of time (e.g. weeks), and engage them in personal dialogues to elaborate on their feelings, thoughts, and real-life events. In this paper, we study the task of response generation in LDs. We evaluate whether general-purpose Pre-trained Language Models (PLM) are appropriate for this purpose. We fine-tune two PLMs, GePpeTto (GPT-2) and iT5, using a dataset of LDs. We experiment with different representations of the personal knowledge extracted from LDs for grounded response generation, including the graph representation of the mentioned events and participants. We evaluate the performance of the models via automatic metrics and the contribution of the knowledge via the Integrated Gradients technique. We categorize the natural language generation errors via human evaluations of contextualization, appropriateness and engagement of the user.
Anthology ID:
2023.nlp4convai-1.1
Volume:
Proceedings of the 5th Workshop on NLP for Conversational AI (NLP4ConvAI 2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Yun-Nung Chen, Abhinav Rastogi
Venue:
NLP4ConvAI
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–11
Language:
URL:
https://aclanthology.org/2023.nlp4convai-1.1
DOI:
10.18653/v1/2023.nlp4convai-1.1
Bibkey:
Cite (ACL):
Seyed Mahed Mousavi, Simone Caldarella, and Giuseppe Riccardi. 2023. Response Generation in Longitudinal Dialogues: Which Knowledge Representation Helps?. In Proceedings of the 5th Workshop on NLP for Conversational AI (NLP4ConvAI 2023), pages 1–11, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Response Generation in Longitudinal Dialogues: Which Knowledge Representation Helps? (Mousavi et al., NLP4ConvAI 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-5/2023.nlp4convai-1.1.pdf