Measure Children’s Mindreading Ability with Machine Reading

Yuliang Yan, Xiaohua Wang, Xiang Zhou, Xiaoqing Zheng, Xuanjing Huang

Abstract
Recently, much research in psychology has benefited from the advances in machine learning techniques. Some recent studies showed that it is possible to build automated scoring models for children’s mindreading. These models were trained on a set of manually-labeled question-response pairs, which were collected by asking children to answer one or two questions after a short story is told or a video clip is played. However, existing models did not take the features of the stories and video clips into account when scoring, which obviously will reduce the accuracy of the scoring models. Furthermore, considering that different psychological tests may contain the same questions, this approach cannot be extended to other related psychological test datasets. In this study, we proposed a multi-modal learning framework to leverage the features extracted from the stories and videos related to the questions being asked during the children’s mindreading evaluation. Experimental results show that the scores produced by the proposed models agree well with those graded by human experts, highlighting the potential of the proposed network architecture for practical automated children’s mindreading scoring systems.
Anthology ID:
2023.findings-emnlp.561
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8366–8375
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.561
DOI:
10.18653/v1/2023.findings-emnlp.561
Bibkey:
Cite (ACL):
Yuliang Yan, Xiaohua Wang, Xiang Zhou, Xiaoqing Zheng, and Xuanjing Huang. 2023. Measure Children’s Mindreading Ability with Machine Reading. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 8366–8375, Singapore. Association for Computational Linguistics.
Cite (Informal):
Measure Children’s Mindreading Ability with Machine Reading (Yan et al., Findings 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/dois-2013-emnlp/2023.findings-emnlp.561.pdf
PDF Search