Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories
Yan Guohang, Liang Feihao, Guo Yaxin, Tan Hongye, Li Ru, Zhang Hu
Abstract
“This paper provides a comprehensive review of the the CCL24-Eval Task 8: Commonsense Reasoning and Moral Understanding in Children’s Stories(CRMUS). This task has designed two sub-tasks, which aim to assess the commonsense reasoning and implicit meaning comprehension capabilities of Large Language Models(LLMs). We heve received registration forms from 33 teams, 15 of which submitted final results that exceeded the baseline score. We present the results of the top 5 teams and our analysis of these results.”- Anthology ID:
- 2024.ccl-3.39
- Volume:
- Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 3: Evaluations)
- Month:
- July
- Year:
- 2024
- Address:
- Taiyuan, China
- Editors:
- Hongfei Lin, Hongye Tan, Bin Li
- Venue:
- CCL
- SIG:
- Publisher:
- Chinese Information Processing Society of China
- Note:
- Pages:
- 346–352
- Language:
- English
- URL:
- https://preview.aclanthology.org/jlcl-multiple-ingestion/2024.ccl-3.39/
- DOI:
- Cite (ACL):
- Yan Guohang, Liang Feihao, Guo Yaxin, Tan Hongye, Li Ru, and Zhang Hu. 2024. Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories. In Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 3: Evaluations), pages 346–352, Taiyuan, China. Chinese Information Processing Society of China.
- Cite (Informal):
- Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories (Guohang et al., CCL 2024)
- PDF:
- https://preview.aclanthology.org/jlcl-multiple-ingestion/2024.ccl-3.39.pdf