Exploring Relationships Between Writing & Broader Outcomes With Automated Writing Evaluation
Jill Burstein, Dan McCaffrey, Beata Beigman Klebanov, Guangming Ling
Abstract
Writing is a challenge, especially for at-risk students who may lack the prerequisite writing skills required to persist in U.S. 4-year postsecondary (college) institutions. Educators teaching postsecondary courses requiring writing could benefit from a better understanding of writing achievement and its role in postsecondary success. In this paper, novel exploratory work examined how automated writing evaluation (AWE) can inform our understanding of the relationship between postsecondary writing skill and broader success outcomes. An exploratory study was conducted using test-taker essays from a standardized writing assessment of postsecondary student learning outcomes. Findings showed that for the essays, AWE features were found to be predictors of broader outcomes measures: college success and learning outcomes measures. Study findings illustrate AWE’s potential to support educational analytics – i.e., relationships between writing skill and broader outcomes – taking a step toward moving AWE beyond writing assessment and instructional use cases.- Anthology ID:
- W17-5011
- Volume:
- Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications
- Month:
- September
- Year:
- 2017
- Address:
- Copenhagen, Denmark
- Editors:
- Joel Tetreault, Jill Burstein, Claudia Leacock, Helen Yannakoudakis
- Venue:
- BEA
- SIG:
- SIGEDU
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 101–108
- Language:
- URL:
- https://aclanthology.org/W17-5011
- DOI:
- 10.18653/v1/W17-5011
- Cite (ACL):
- Jill Burstein, Dan McCaffrey, Beata Beigman Klebanov, and Guangming Ling. 2017. Exploring Relationships Between Writing & Broader Outcomes With Automated Writing Evaluation. In Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications, pages 101–108, Copenhagen, Denmark. Association for Computational Linguistics.
- Cite (Informal):
- Exploring Relationships Between Writing & Broader Outcomes With Automated Writing Evaluation (Burstein et al., BEA 2017)
- PDF:
- https://preview.aclanthology.org/corrections-2024-07/W17-5011.pdf