Improving Prompt Generalization for Cross-prompt Essay Trait Scoring from the Scoring-invariance Perspective

Jiong Wang, Shengquan Yu


Abstract
Cross-prompt trait scoring task aims to learn generalizable scoring capabilities from source- prompt data, enabling automatic scoring across multiple dimensions on unseen essays. Existing research on cross-prompt trait essay scoring primarily focuses on improving model generalization by obtaining prompt-invariant representations. In this paper, we approach the research problem from a different perspective on invariance learning and propose a scoring-invariant learning objective. This objective encourages the model to focus on intrinsic information within the essay that reflects its quality during training, thereby learning generic scoring features. To further enhance the model’s ability to score across multiple dimensions, we introduce a trait feature extraction network based on routing gates into the scoring architecture and propose a trait consistency scoring objective to encourage the model to balance the diversity of trait-specific features with scoring consistency across traits when learning trait-specific essay features. Extensive experiments demonstrate the effectiveness of our approach, showing advantages in multi-trait scoring performance and achieving significant improvements with low-resource prompts.
Anthology ID:
2025.findings-emnlp.142
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2633–2646
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.142/
DOI:
10.18653/v1/2025.findings-emnlp.142
Bibkey:
Cite (ACL):
Jiong Wang and Shengquan Yu. 2025. Improving Prompt Generalization for Cross-prompt Essay Trait Scoring from the Scoring-invariance Perspective. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 2633–2646, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Improving Prompt Generalization for Cross-prompt Essay Trait Scoring from the Scoring-invariance Perspective (Wang & Yu, Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.142.pdf
Checklist:
 2025.findings-emnlp.142.checklist.pdf