Abstract
There has been much recent progress in natural language processing, and grammatical error correction (GEC) is no exception. We found that state-of-the-art GEC systems (T5 and GECToR) outperform humans by a wide margin on the CoNLL-2014 test set, a benchmark GEC test corpus, as measured by the standard F0.5 evaluation metric. However, a careful examination of their outputs reveals that there are still classes of errors that they fail to correct. This suggests that creating new test data that more accurately measure the true performance of GEC systems constitutes important future work.- Anthology ID:
- 2022.coling-1.246
- Volume:
- Proceedings of the 29th International Conference on Computational Linguistics
- Month:
- October
- Year:
- 2022
- Address:
- Gyeongju, Republic of Korea
- Venue:
- COLING
- SIG:
- Publisher:
- International Committee on Computational Linguistics
- Note:
- Pages:
- 2794–2800
- Language:
- URL:
- https://aclanthology.org/2022.coling-1.246
- DOI:
- Cite (ACL):
- Muhammad Reza Qorib and Hwee Tou Ng. 2022. Grammatical Error Correction: Are We There Yet?. In Proceedings of the 29th International Conference on Computational Linguistics, pages 2794–2800, Gyeongju, Republic of Korea. International Committee on Computational Linguistics.
- Cite (Informal):
- Grammatical Error Correction: Are We There Yet? (Qorib & Ng, COLING 2022)
- PDF:
- https://preview.aclanthology.org/auto-file-uploads/2022.coling-1.246.pdf
- Data
- JFLEG