Revisiting the Systematicity in Negation in the Era of In-Context Learning

Hitomi Yanaka, Taisei Yamamoto


Abstract
Understanding the meaning of negated sentences remains one of the challenges for language models even in the era of large language models (LLMs). We analyze systematicity regarding LLM understanding of negation from two perspectives: behavioral systematicity and representational systematicity. For behavioral systematicity, we confirm that through demonstrations and in-context learning, LLMs can recognize negation expressions and negation scope within sentences to some extent, but they fail to achieve perfect performance. In particular, the difficulty of the negation scope recognition for models varies depending on the output format. For representational systematicity, we analyze the extent to which LLMs can construct function vectors related to the tasks necessary for understanding negation from in-context examples. The experiments suggest that while models can compose the function vectors for negation tasks, extracting the function vector for recognizing scope is more challenging.
Anthology ID:
2026.naloma-1.1
Volume:
Proceedings of the 6th Workshop on Natural Language Meets Logic and Machine Learning (NALOMA)
Month:
August
Year:
2026
Address:
Prague, Czechia
Editors:
Hitomi Yanaka, Lasha Abzianidze
Venues:
NALOMA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–8
Language:
URL:
https://preview.aclanthology.org/ingest-naloma/2026.naloma-1.1/
DOI:
Bibkey:
Cite (ACL):
Hitomi Yanaka and Taisei Yamamoto. 2026. Revisiting the Systematicity in Negation in the Era of In-Context Learning. In Proceedings of the 6th Workshop on Natural Language Meets Logic and Machine Learning (NALOMA), pages 1–8, Prague, Czechia. Association for Computational Linguistics.
Cite (Informal):
Revisiting the Systematicity in Negation in the Era of In-Context Learning (Yanaka & Yamamoto, NALOMA 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-naloma/2026.naloma-1.1.pdf