Finding Sense in Nonsense with Generated Contexts: Perspectives from Humans and Language Models

Katrina Olsen, Sebastian Padó


Abstract
Nonsensical and anomalous sentences have been instrumental in the development of computational models of semantic interpretation. A core challenge is to distinguish between what is merely anomalous (but can be interpreted given a supporting context) and what is truly nonsensical. However, it is unclear (a) how nonsensical, rather than merely anomalous, existing datasets are; and (b) how well LLMs can make this distinction. In this paper, we answer both questions by collecting sensicality judgments from human raters and LLMs on sentences from five semantically deviant datasets—both context-free and when providing a context. We find that raters consider most sentences at most anomalous, and only a few as properly nonsensical. We also show that LLMs are substantially skilled in generating plausible contexts for anomalous cases.
Anthology ID:
2026.starsem-conference.6
Volume:
Proceedings of the 15th Joint Conference on Lexical and Computational Semantics (*SEM 2026)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Saif M. Mohammad, Nedjma Ousidhoum
Venues:
*SEM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
98–110
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.starsem-conference.6/
DOI:
Bibkey:
Cite (ACL):
Katrina Olsen and Sebastian Padó. 2026. Finding Sense in Nonsense with Generated Contexts: Perspectives from Humans and Language Models. In Proceedings of the 15th Joint Conference on Lexical and Computational Semantics (*SEM 2026), pages 98–110, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Finding Sense in Nonsense with Generated Contexts: Perspectives from Humans and Language Models (Olsen & Padó, *SEM 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.starsem-conference.6.pdf