Generating Diverse Story Continuations with Controllable Semantics

Lifu Tu, Xiaoan Ding, Dong Yu, Kevin Gimpel


Abstract
We propose a simple and effective modeling framework for controlled generation of multiple, diverse outputs. We focus on the setting of generating the next sentence of a story given its context. As controllable dimensions, we consider several sentence attributes, including sentiment, length, predicates, frames, and automatically-induced clusters. Our empirical results demonstrate: (1) our framework is accurate in terms of generating outputs that match the target control values; (2) our model yields increased maximum metric scores compared to standard n-best list generation via beam search; (3) controlling generation with semantic frames leads to a stronger combination of diversity and quality than other control variables as measured by automatic metrics. We also conduct a human evaluation to assess the utility of providing multiple suggestions for creative writing, demonstrating promising results for the potential of controllable, diverse generation in a collaborative writing system.
Anthology ID:
D19-5605
Volume:
Proceedings of the 3rd Workshop on Neural Generation and Translation
Month:
November
Year:
2019
Address:
Hong Kong
Editors:
Alexandra Birch, Andrew Finch, Hiroaki Hayashi, Ioannis Konstas, Thang Luong, Graham Neubig, Yusuke Oda, Katsuhito Sudoh
Venue:
NGT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
44–58
Language:
URL:
https://aclanthology.org/D19-5605
DOI:
10.18653/v1/D19-5605
Bibkey:
Cite (ACL):
Lifu Tu, Xiaoan Ding, Dong Yu, and Kevin Gimpel. 2019. Generating Diverse Story Continuations with Controllable Semantics. In Proceedings of the 3rd Workshop on Neural Generation and Translation, pages 44–58, Hong Kong. Association for Computational Linguistics.
Cite (Informal):
Generating Diverse Story Continuations with Controllable Semantics (Tu et al., NGT 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-3/D19-5605.pdf
Data
FrameNet