Abstract
Large language models such as GPT-3, GPT4, Claude etc., have advanced the state of the art in several natural language generation tasks such as text summarization and machine translation. However when it comes to open-ended tasks with a focus on creativity such as generating stories, poetry, or various forms of figurative language, these state-of-the-art language models are often found to be inadequate. This tutorial aims to bring awareness of the important and emerging research area of open-domain creative generation, with a focus on language generation while also touching on multi-modal generation (e.g., image captioning, visual metaphors). It targets natural language processing (NLP) and artificial intelligence (AI) researchers as well as creative writing practitioners who are interested in building systems that are capable of emulating as well as augmenting human creativity. In particular, we will review recent studies on creative language generation both at the sentence level as well as longer forms of text. We will provide the audiences with a holistic view of 1) the importance and challenges of building creative language generation systems; 2) how we incorporate content planning, domain knowledge and creativity specific heuristics for different forms of creative language generation such as story, poetry, humor, metaphors etc 3) how can we build better evaluation methods for creative text generation? In particular, how could the recent advancement of AI shape the future workforce for creativity? We will conclude the tutorial by outlining future research directions in this area.- Anthology ID:
- 2023.emnlp-tutorial.6
- Volume:
- Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts
- Month:
- December
- Year:
- 2023
- Address:
- Singapore
- Editors:
- Qi Zhang, Hassan Sajjad
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 34–40
- Language:
- URL:
- https://aclanthology.org/2023.emnlp-tutorial.6
- DOI:
- 10.18653/v1/2023.emnlp-tutorial.6
- Cite (ACL):
- Tuhin Chakrabarty, Vishakh Padmakumar, He He, and Nanyun Peng. 2023. Creative Natural Language Generation. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts, pages 34–40, Singapore. Association for Computational Linguistics.
- Cite (Informal):
- Creative Natural Language Generation (Chakrabarty et al., EMNLP 2023)
- PDF:
- https://preview.aclanthology.org/dois-2013-emnlp/2023.emnlp-tutorial.6.pdf