Help me write a Poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing

Tuhin Chakrabarty, Vishakh Padmakumar, He He

Abstract
Recent work in training large language models (LLMs) to follow natural language instructions has opened up exciting opportunities for natural language interface design. Building on the prior success of large language models in the realm of computer assisted creativity, in this work, we present CoPoet, a collaborative poetry writing system, with the goal of to study if LLM’s actually improve the quality of the generated content. In contrast to auto-completing a user’s text, CoPoet is controlled by user instructions that specify the attributes of the desired text, such as Write a sentence about ‘love’ or Write a sentence ending in ‘fly’. The core component of our system is a language model fine-tuned on a diverse collection of instructions for poetry writing. Our model is not only competitive to publicly available LLMs trained on instructions (InstructGPT), but also capable of satisfying unseen compositional instructions. A study with 15 qualified crowdworkers shows that users successfully write poems with CoPoet on diverse topics ranging from Monarchy to Climate change, which are preferred by third-party evaluators over poems written without the system.
Anthology ID:
2022.emnlp-main.460
Volume:
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6848–6863
Language:
URL:
https://aclanthology.org/2022.emnlp-main.460
DOI:
Bibkey:
Cite (ACL):
Tuhin Chakrabarty, Vishakh Padmakumar, and He He. 2022. Help me write a Poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 6848–6863, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
Help me write a Poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing (Chakrabarty et al., EMNLP 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/nodalida-main-page/2022.emnlp-main.460.pdf
PDF Search