Modeling Semantic Relationship in Multi-turn Conversations with Hierarchical Latent Variables

Lei Shen, Yang Feng, Haolan Zhan


Abstract
Multi-turn conversations consist of complex semantic structures, and it is still a challenge to generate coherent and diverse responses given previous utterances. It’s practical that a conversation takes place under a background, meanwhile, the query and response are usually most related and they are consistent in topic but also different in content. However, little work focuses on such hierarchical relationship among utterances. To address this problem, we propose a Conversational Semantic Relationship RNN (CSRR) model to construct the dependency explicitly. The model contains latent variables in three hierarchies. The discourse-level one captures the global background, the pair-level one stands for the common topic information between query and response, and the utterance-level ones try to represent differences in content. Experimental results show that our model significantly improves the quality of responses in terms of fluency, coherence, and diversity compared to baseline methods.
Anthology ID:
P19-1549
Volume:
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
Month:
July
Year:
2019
Address:
Florence, Italy
Editors:
Anna Korhonen, David Traum, Lluís Màrquez
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5497–5502
Language:
URL:
https://aclanthology.org/P19-1549
DOI:
10.18653/v1/P19-1549
Bibkey:
Cite (ACL):
Lei Shen, Yang Feng, and Haolan Zhan. 2019. Modeling Semantic Relationship in Multi-turn Conversations with Hierarchical Latent Variables. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 5497–5502, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Modeling Semantic Relationship in Multi-turn Conversations with Hierarchical Latent Variables (Shen et al., ACL 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-5/P19-1549.pdf