Overview of CCL25-Eval Task 7: Chinese Literary Language Understanding Evaluation (ZhengMing)

Kang Wang, Qing Wang, Min Peng, Kun Yue, Gang Hu


Abstract
"The 24th Chinese Computational Linguistics Conference (CCL25-Eval) features 12 technical evaluation tasks. Among them, Task 7 is the Chinese Literary Language Understanding Evaluation (ZhengMing). ZhengMing is a universal and scalable evaluation framework designed to assess natural language processing (NLP) tasks in the literary domain, such as text classification, text generation, automated question answering, relation extraction, and machine translation.ZhengMing framework aims to evaluate the performance of large language models (LLMs) in the literary field at a fine-grained level. In this mission, 89 teams signed up for the competition, with5 teams ultimately submitting results. The highest score achieved is 0.65. This paper presents and discusses the dataset, task descriptions, competition results, and other relevant information for this evaluation task. This paper introduces and presents relevant information about this evaluation task, including the dataset, task description, and competition results. More details are available at https://github.com/isShayulajiao/CCL25-Eval-ZhengMing."
Anthology ID:
2025.ccl-2.34
Volume:
Proceedings of the 24th China National Conference on Computational Linguistics (CCL 2025)
Month:
August
Year:
2025
Address:
Jinan, China
Editors:
Hongfei Lin, Bin Li, Hongye Tan
Venue:
CCL
SIG:
Publisher:
Chinese Information Processing Society of China
Note:
Pages:
288–297
Language:
URL:
https://preview.aclanthology.org/ingest-ccl/2025.ccl-2.34/
DOI:
Bibkey:
Cite (ACL):
Kang Wang, Qing Wang, Min Peng, Kun Yue, and Gang Hu. 2025. Overview of CCL25-Eval Task 7: Chinese Literary Language Understanding Evaluation (ZhengMing). In Proceedings of the 24th China National Conference on Computational Linguistics (CCL 2025), pages 288–297, Jinan, China. Chinese Information Processing Society of China.
Cite (Informal):
Overview of CCL25-Eval Task 7: Chinese Literary Language Understanding Evaluation (ZhengMing) (Wang et al., CCL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-ccl/2025.ccl-2.34.pdf