Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories

Guohang Yan, Feihao Liang, Yaxin Guo, Hongye Tan, Ru Li, Hu Zhang


Abstract
“This paper provides a comprehensive review of the the CCL24-Eval Task 8: Commonsense Reasoning and Moral Understanding in Children’s Stories(CRMUS). This task has designed two sub-tasks, which aim to assess the commonsense reasoning and implicit meaning comprehension capabilities of Large Language Models(LLMs). We heve received registration forms from 33 teams, 15 of which submitted final results that exceeded the baseline score. We present the results of the top 5 teams and our analysis of these results.”
Anthology ID:
2024.ccl-3.39
Volume:
Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 3: Evaluations)
Month:
July
Year:
2024
Address:
Taiyuan, China
Editors:
Lin Hongfei, Tan Hongye, Li Bin
Venue:
CCL
SIG:
Publisher:
Chinese Information Processing Society of China
Note:
Pages:
346–352
Language:
English
URL:
https://preview.aclanthology.org/author-degibert/2024.ccl-3.39/
DOI:
Bibkey:
Cite (ACL):
Guohang Yan, Feihao Liang, Yaxin Guo, Hongye Tan, Ru Li, and Hu Zhang. 2024. Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories. In Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 3: Evaluations), pages 346–352, Taiyuan, China. Chinese Information Processing Society of China.
Cite (Informal):
Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories (Yan et al., CCL 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-degibert/2024.ccl-3.39.pdf