Automatic Evaluation of Neural Personality-based Chatbots

Yujie Xing, Raquel Fernández


Abstract
Stylistic variation is critical to render the utterances generated by conversational agents natural and engaging. In this paper, we focus on sequence-to-sequence models for open-domain dialogue response generation and propose a new method to evaluate the extent to which such models are able to generate responses that reflect different personality traits.
Anthology ID:
W18-6524
Volume:
Proceedings of the 11th International Conference on Natural Language Generation
Month:
November
Year:
2018
Address:
Tilburg University, The Netherlands
Editors:
Emiel Krahmer, Albert Gatt, Martijn Goudbeek
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
189–194
Language:
URL:
https://aclanthology.org/W18-6524
DOI:
10.18653/v1/W18-6524
Bibkey:
Cite (ACL):
Yujie Xing and Raquel Fernández. 2018. Automatic Evaluation of Neural Personality-based Chatbots. In Proceedings of the 11th International Conference on Natural Language Generation, pages 189–194, Tilburg University, The Netherlands. Association for Computational Linguistics.
Cite (Informal):
Automatic Evaluation of Neural Personality-based Chatbots (Xing & Fernández, INLG 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-3/W18-6524.pdf