Exploring Relationships Between Writing & Broader Outcomes With Automated Writing Evaluation

Jill Burstein, Dan McCaffrey, Beata Beigman Klebanov, Guangming Ling

Abstract
Writing is a challenge, especially for at-risk students who may lack the prerequisite writing skills required to persist in U.S. 4-year postsecondary (college) institutions. Educators teaching postsecondary courses requiring writing could benefit from a better understanding of writing achievement and its role in postsecondary success. In this paper, novel exploratory work examined how automated writing evaluation (AWE) can inform our understanding of the relationship between postsecondary writing skill and broader success outcomes. An exploratory study was conducted using test-taker essays from a standardized writing assessment of postsecondary student learning outcomes. Findings showed that for the essays, AWE features were found to be predictors of broader outcomes measures: college success and learning outcomes measures. Study findings illustrate AWE’s potential to support educational analytics – i.e., relationships between writing skill and broader outcomes – taking a step toward moving AWE beyond writing assessment and instructional use cases.
Anthology ID:
W17-5011
Volume:
Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications
Month:
September
Year:
2017
Address:
Copenhagen, Denmark
Editors:
Joel Tetreault, Jill Burstein, Claudia Leacock, Helen Yannakoudakis
Venue:
BEA
SIG:
SIGEDU
Publisher:
Association for Computational Linguistics
Note:
Pages:
101–108
Language:
URL:
https://aclanthology.org/W17-5011
DOI:
10.18653/v1/W17-5011
Bibkey:
Cite (ACL):
Jill Burstein, Dan McCaffrey, Beata Beigman Klebanov, and Guangming Ling. 2017. Exploring Relationships Between Writing & Broader Outcomes With Automated Writing Evaluation. In Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications, pages 101–108, Copenhagen, Denmark. Association for Computational Linguistics.
Cite (Informal):
Exploring Relationships Between Writing & Broader Outcomes With Automated Writing Evaluation (Burstein et al., BEA 2017)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-5/W17-5011.pdf
PDF Search