Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories
Guohang Yan, Feihao Liang, Yaxin Guo, Hongye Tan, Ru Li, Hu Zhang
Abstract
“This paper provides a comprehensive review of the the CCL24-Eval Task 8: Commonsense Reasoning and Moral Understanding in Children’s Stories(CRMUS). This task has designed two sub-tasks, which aim to assess the commonsense reasoning and implicit meaning comprehension capabilities of Large Language Models(LLMs). We heve received registration forms from 33 teams, 15 of which submitted final results that exceeded the baseline score. We present the results of the top 5 teams and our analysis of these results.”- Anthology ID:
- 2024.ccl-3.39
- Volume:
- Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 3: Evaluations)
- Month:
- July
- Year:
- 2024
- Address:
- Taiyuan, China
- Editors:
- Lin Hongfei, Tan Hongye, Li Bin
- Venue:
- CCL
- SIG:
- Publisher:
- Chinese Information Processing Society of China
- Note:
- Pages:
- 346–352
- Language:
- English
- URL:
- https://preview.aclanthology.org/author-degibert/2024.ccl-3.39/
- DOI:
- Cite (ACL):
- Guohang Yan, Feihao Liang, Yaxin Guo, Hongye Tan, Ru Li, and Hu Zhang. 2024. Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories. In Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 3: Evaluations), pages 346–352, Taiyuan, China. Chinese Information Processing Society of China.
- Cite (Informal):
- Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories (Yan et al., CCL 2024)
- PDF:
- https://preview.aclanthology.org/author-degibert/2024.ccl-3.39.pdf