Refined Evaluation for End-to-End Grammatical Error Correction Using an Alignment-Based Approach
Junrui Wang, Mengyang Qiu, Yang Gu, Zihao Huang, Jungyeul Park
Abstract
We propose a refined alignment-based method to assess end-to-end grammatical error correction (GEC) systems, aiming to reproduce and improve results from existing evaluation tools, such as errant, even when applied to raw text input—reflecting real-world language learners’ writing scenarios. Our approach addresses challenges arising from sentence boundary detection deviations in text preprocessing, a factor overlooked by current GEC evaluation metrics. We demonstrate its effectiveness by replicating results through a re-implementation of errant, utilizing stanza for error annotation and simulating end-to-end evaluation from raw text. Additionally, we propose a potential multilingual errant, presenting Chinese and Korean GEC results. Previously, Chinese and Korean errant were implemented independently for each language, with different annotation formats. Our approach generates consistent error annotations across languages, establishing a basis for standardized grammatical error annotation and evaluation in multilingual GEC contexts.- Anthology ID:
- 2025.coling-main.52
- Volume:
- Proceedings of the 31st International Conference on Computational Linguistics
- Month:
- January
- Year:
- 2025
- Address:
- Abu Dhabi, UAE
- Editors:
- Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
- Venue:
- COLING
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 774–785
- Language:
- URL:
- https://preview.aclanthology.org/remove-affiliations/2025.coling-main.52/
- DOI:
- Cite (ACL):
- Junrui Wang, Mengyang Qiu, Yang Gu, Zihao Huang, and Jungyeul Park. 2025. Refined Evaluation for End-to-End Grammatical Error Correction Using an Alignment-Based Approach. In Proceedings of the 31st International Conference on Computational Linguistics, pages 774–785, Abu Dhabi, UAE. Association for Computational Linguistics.
- Cite (Informal):
- Refined Evaluation for End-to-End Grammatical Error Correction Using an Alignment-Based Approach (Wang et al., COLING 2025)
- PDF:
- https://preview.aclanthology.org/remove-affiliations/2025.coling-main.52.pdf