Overview of CCL25-Eval Task 11: Evaluation of the Quality of Handwritten Chinese Characters

Meng Wang, Shicong Lu, Zhidan Hu, Chen Su, Yujie Cao


Abstract
"As an important means of disseminating Chinese cultural heritage, the development of Chinese handwriting skills faces dual challenges in the digital era: insufficient pedagogical resources anda lack of personalized feedback. At the 24th China National Conference on Computational Linguistics (CCL 2025), we organized a handwritten Chinese character evaluation task focusing on writing quality grading and comments generation. This benchmark utilized an expert-annotated calligraphic dataset to enhance task efficacy. Eight teams participated in the evaluation, three ofwhich submitted valid entries. In the character grading subtask, the top-performing team achieved an F1-score of 90.5%, whereas the optimal system in the comments generation subtask attained a score of 52.8%."
Anthology ID:
2025.ccl-2.54
Volume:
Proceedings of the 24th China National Conference on Computational Linguistics (CCL 2025)
Month:
August
Year:
2025
Address:
Jinan, China
Editors:
Hongfei Lin, Bin Li, Hongye Tan
Venue:
CCL
SIG:
Publisher:
Chinese Information Processing Society of China
Note:
Pages:
452–460
Language:
URL:
https://preview.aclanthology.org/ingest-ccl/2025.ccl-2.54/
DOI:
Bibkey:
Cite (ACL):
Meng Wang, Shicong Lu, Zhidan Hu, Chen Su, and Yujie Cao. 2025. Overview of CCL25-Eval Task 11: Evaluation of the Quality of Handwritten Chinese Characters. In Proceedings of the 24th China National Conference on Computational Linguistics (CCL 2025), pages 452–460, Jinan, China. Chinese Information Processing Society of China.
Cite (Informal):
Overview of CCL25-Eval Task 11: Evaluation of the Quality of Handwritten Chinese Characters (Wang et al., CCL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-ccl/2025.ccl-2.54.pdf