Human Temporal Inferences Go Beyond Aspectual Class

Katarzyna Pruś, Mark Steedman, Adam Lopez


Abstract
Past work in NLP has proposed the task of classifying English verb phrases into situation aspect categories, assuming that these categories play an important role in tasks requiring temporal reasoning. We investigate this assumption by gathering crowd-sourced judgements about aspectual entailments from non-expert, native English participants. The results suggest that aspectual class alone is not sufficient to explain the response patterns of the participants. We propose that looking at scenarios which can feasibly accompany an action description contributes towards a better explanation of the participants’ answers. A further experiment using GPT-3.5 shows that its outputs follow different patterns than human answers, suggesting that such conceivable scenarios cannot be fully accounted for in the language alone. We release our dataset to support further research.
Anthology ID:
2024.eacl-long.115
Volume:
Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2024
Address:
St. Julian’s, Malta
Editors:
Yvette Graham, Matthew Purver
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1913–1923
Language:
URL:
https://aclanthology.org/2024.eacl-long.115
DOI:
Bibkey:
Cite (ACL):
Katarzyna Pruś, Mark Steedman, and Adam Lopez. 2024. Human Temporal Inferences Go Beyond Aspectual Class. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1913–1923, St. Julian’s, Malta. Association for Computational Linguistics.
Cite (Informal):
Human Temporal Inferences Go Beyond Aspectual Class (Pruś et al., EACL 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/add_acl24_videos/2024.eacl-long.115.pdf
Video:
 https://preview.aclanthology.org/add_acl24_videos/2024.eacl-long.115.mp4