Representation-to-Creativity (R2C): Automated Holistic Scoring Model for Essay Creativity

Deokgi Kim, Joonyoung Jo, Byung-Won On, Ingyu Lee


Abstract
Despite active research on Automated Essay Scoring (AES), there is a noticeable scarcity of studies focusing on predicting creativity scores for essays. In this study, we develop a new essay rubric specifically designed for assessing creativity in essays. Leveraging this rubric, we construct ground truth data consisting of 5,048 essays. Furthermore, we propose a novel self-supervised learning model that recognizes cluster patterns within the essay embedding space and leverages them for creativity scoring. This approach aims to automatically generate a high-quality training set, thereby facilitating the training of diverse language models. Our experimental findings indicated a substantial enhancement in the assessment of essay creativity, demonstrating an increase in F1-score up to 58% compared to the primary state-of-the-art models across the ASAP and AIHUB datasets.
Anthology ID:
2025.findings-naacl.292
Volume:
Findings of the Association for Computational Linguistics: NAACL 2025
Month:
April
Year:
2025
Address:
Albuquerque, New Mexico
Editors:
Luis Chiruzzo, Alan Ritter, Lu Wang
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5257–5275
Language:
URL:
https://preview.aclanthology.org/fix-sig-urls/2025.findings-naacl.292/
DOI:
Bibkey:
Cite (ACL):
Deokgi Kim, Joonyoung Jo, Byung-Won On, and Ingyu Lee. 2025. Representation-to-Creativity (R2C): Automated Holistic Scoring Model for Essay Creativity. In Findings of the Association for Computational Linguistics: NAACL 2025, pages 5257–5275, Albuquerque, New Mexico. Association for Computational Linguistics.
Cite (Informal):
Representation-to-Creativity (R2C): Automated Holistic Scoring Model for Essay Creativity (Kim et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-sig-urls/2025.findings-naacl.292.pdf