Retrieval-Augmented Controllable Review Generation

Jihyeok Kim, Seungtaek Choi, Reinald Kim Amplayo, Seung-won Hwang

Abstract
In this paper, we study review generation given a set of attribute identifiers which are user ID, product ID and rating. This is a difficult subtask of natural language generation since models are limited to the given identifiers, without any specific descriptive information regarding the inputs, when generating the text. The capacity of these models is thus confined and dependent to how well the models can capture vector representations of attributes. We thus propose to additionally leverage references, which are selected from a large pool of texts labeled with one of the attributes, as textual information that enriches inductive biases of given attributes. With these references, we can now pose the problem as an instance of text-to-text generation, which makes the task easier since texts that are syntactically, semantically similar with the output text are provided as input. Using this framework, we address issues such as selecting references from a large candidate set without textual context and improving the model complexity for generation. Our experiments show that our models improve over previous approaches on both automatic and human evaluation metrics.
Anthology ID:
2020.coling-main.207
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Donia Scott, Nuria Bel, Chengqing Zong
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
2284–2295
Language:
URL:
https://aclanthology.org/2020.coling-main.207
DOI:
10.18653/v1/2020.coling-main.207
Bibkey:
Cite (ACL):
Jihyeok Kim, Seungtaek Choi, Reinald Kim Amplayo, and Seung-won Hwang. 2020. Retrieval-Augmented Controllable Review Generation. In Proceedings of the 28th International Conference on Computational Linguistics, pages 2284–2295, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
Retrieval-Augmented Controllable Review Generation (Kim et al., COLING 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2020.coling-main.207.pdf
PDF Search