Textual Time Travel: A Temporally Informed Approach to Theory of Mind

Akshatha Arodi, Jackie Chi Kit Cheung


Abstract
Natural language processing systems such as dialogue agents should be able to reason about other people’s beliefs, intentions and desires. This capability, called theory of mind (ToM), is crucial, as it allows a model to predict and interpret the needs of users based on their mental states. A recent line of research evaluates the ToM capability of existing memory-augmented neural models through question-answering. These models perform poorly on false belief tasks where beliefs differ from reality, especially when the dataset contains distracting sentences. In this paper, we propose a new temporally informed approach for improving the ToM capability of memory-augmented neural models. Our model incorporates priors about the entities’ minds and tracks their mental states as they evolve over time through an extended passage. It then responds to queries through textual time travel–i.e., by accessing the stored memory of an earlier time step. We evaluate our model on ToM datasets and find that this approach improves performance, particularly by correcting the predicted mental states to match the false belief.
Anthology ID:
2021.findings-emnlp.351
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2021
Month:
November
Year:
2021
Address:
Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
4162–4172
Language:
URL:
https://aclanthology.org/2021.findings-emnlp.351
DOI:
10.18653/v1/2021.findings-emnlp.351
Bibkey:
Cite (ACL):
Akshatha Arodi and Jackie Chi Kit Cheung. 2021. Textual Time Travel: A Temporally Informed Approach to Theory of Mind. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 4162–4172, Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Textual Time Travel: A Temporally Informed Approach to Theory of Mind (Arodi & Cheung, Findings 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp-22-attachments/2021.findings-emnlp.351.pdf
Video:
 https://preview.aclanthology.org/emnlp-22-attachments/2021.findings-emnlp.351.mp4