“What is on your mind?” Automated Scoring of Mindreading in Childhood and Early Adolescence

Venelin Kovatchev, Phillip Smith, Mark Lee, Imogen Grumley Traynor, Irene Luque Aguilera, Rory Devine


Abstract
In this paper we present the first work on the automated scoring of mindreading ability in middle childhood and early adolescence. We create MIND-CA, a new corpus of 11,311 question-answer pairs in English from 1,066 children aged from 7 to 14. We perform machine learning experiments and carry out extensive quantitative and qualitative evaluation. We obtain promising results, demonstrating the applicability of state-of-the-art NLP solutions to a new domain and task.
Anthology ID:
2020.coling-main.547
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Donia Scott, Nuria Bel, Chengqing Zong
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
6217–6228
Language:
URL:
https://aclanthology.org/2020.coling-main.547
DOI:
10.18653/v1/2020.coling-main.547
Bibkey:
Cite (ACL):
Venelin Kovatchev, Phillip Smith, Mark Lee, Imogen Grumley Traynor, Irene Luque Aguilera, and Rory Devine. 2020. “What is on your mind?” Automated Scoring of Mindreading in Childhood and Early Adolescence. In Proceedings of the 28th International Conference on Computational Linguistics, pages 6217–6228, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
“What is on your mind?” Automated Scoring of Mindreading in Childhood and Early Adolescence (Kovatchev et al., COLING 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp22-frontmatter/2020.coling-main.547.pdf