Plug-and-Play Conversational Models

Andrea Madotto, Etsuko Ishii, Zhaojiang Lin, Sumanth Dathathri, Pascale Fung

Abstract
There has been considerable progress made towards conversational models that generate coherent and fluent responses; however, this often involves training large language models on large dialogue datasets, such as Reddit. These large conversational models provide little control over the generated responses, and this control is further limited in the absence of annotated conversational datasets for attribute specific generation that can be used for fine-tuning the model. In this paper, we first propose and evaluate plug-and-play methods for controllable response generation, which does not require dialogue specific datasets and does not rely on fine-tuning a large model. While effective, the decoding procedure induces considerable computational overhead, rendering the conversational model unsuitable for interactive usage. To overcome this, we introduce an approach that does not require further computation at decoding time, while also does not require any fine-tuning of a large language model. We demonstrate, through extensive automatic and human evaluation, a high degree of control over the generated conversational responses with regard to multiple desired attributes, while being fluent.
Anthology ID:
2020.findings-emnlp.219
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2020
Month:
November
Year:
2020
Address:
Online
Editors:
Trevor Cohn, Yulan He, Yang Liu
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2422–2433
Language:
URL:
https://aclanthology.org/2020.findings-emnlp.219
DOI:
10.18653/v1/2020.findings-emnlp.219
Bibkey:
Cite (ACL):
Andrea Madotto, Etsuko Ishii, Zhaojiang Lin, Sumanth Dathathri, and Pascale Fung. 2020. Plug-and-Play Conversational Models. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 2422–2433, Online. Association for Computational Linguistics.
Cite (Informal):
Plug-and-Play Conversational Models (Madotto et al., Findings 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2020.findings-emnlp.219.pdf
Optional supplementary material:
 2020.findings-emnlp.219.OptionalSupplementaryMaterial.pdf
Code
 andreamad8/PPCM
Data
AG News, SST, SST-5
PDF Search Code Optional supplementary material