gec-metrics: A Unified Library for Grammatical Error Correction Evaluation

Takumi Goto, Yusuke Sakai, Taro Watanabe


Abstract
We introduce gec-metrics, a library for using and developing grammatical error correction (GEC) evaluation metrics through a unified interface. Our library enables fair system comparisons by ensuring that everyone conducts evaluations using a consistent implementation. Moreover, it is designed with a strong focus on API usage, making it highly extensible. It also includes meta-evaluation functionalities and provides analysis and visualization scripts, contributing to developing GEC evaluation metrics. Our code is released under the MIT license1 and is also distributed as an installable package2. The video is available at YouTube3.1GitHub: https://github.com/gotutiyan/gec-metrics2PyPi: https://pypi.org/project/gec-metrics/3Video: https://youtu.be/cor6dkN6EfI
Anthology ID:
2025.acl-demo.50
Volume:
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Pushkar Mishra, Smaranda Muresan, Tao Yu
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
524–534
Language:
URL:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-demo.50/
DOI:
Bibkey:
Cite (ACL):
Takumi Goto, Yusuke Sakai, and Taro Watanabe. 2025. gec-metrics: A Unified Library for Grammatical Error Correction Evaluation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations), pages 524–534, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
gec-metrics: A Unified Library for Grammatical Error Correction Evaluation (Goto et al., ACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-demo.50.pdf
Copyright agreement:
 2025.acl-demo.50.copyright_agreement.pdf