Abstract
Automating the assessment of learner summary provides a useful tool for assessing learner reading comprehension. We present a summarization task for evaluating non-native reading comprehension and propose three novel approaches to automatically assess the learner summaries. We evaluate our models on two datasets we created and show that our models outperform traditional approaches that rely on exact word match on this task. Our best model produces quality assessments close to professional examiners.- Anthology ID:
- N19-1261
- Volume:
- Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)
- Month:
- June
- Year:
- 2019
- Address:
- Minneapolis, Minnesota
- Venue:
- NAACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2532–2542
- Language:
- URL:
- https://aclanthology.org/N19-1261
- DOI:
- 10.18653/v1/N19-1261
- Cite (ACL):
- Menglin Xia, Ekaterina Kochmar, and Ted Briscoe. 2019. Automatic learner summary assessment for reading comprehension. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 2532–2542, Minneapolis, Minnesota. Association for Computational Linguistics.
- Cite (Informal):
- Automatic learner summary assessment for reading comprehension (Xia et al., NAACL 2019)
- PDF:
- https://preview.aclanthology.org/nodalida-main-page/N19-1261.pdf