Thunder-KoNUBench: A Corpus-Aligned Benchmark for Korean Negation Understanding

Sungmok Jung, Yeonkyoung So, Joonhak Lee, Sangho Kim, Yelim Ahn, Jaejin Lee


Abstract
Although negation is known to challenge large language models (LLMs), benchmarks for evaluating negation understanding—especially in Korean—are scarce. We conduct a corpus-based analysis of Korean negation and show that LLM performance degrades under negation. We then introduce *Thunder-KoNUBench*, a sentence-level negation understanding benchmark that reflects the empirical distribution of Korean negation phenomena. Evaluating 47 LLMs on Thunder-KoNUBench, we analyze the effects of model size and instruction tuning, and perform error analysis to better understand model behavior. We further show that fine-tuning on Thunder-KoNUBench improves negation understanding and broader contextual comprehension in Korean.
Anthology ID:
2026.findings-acl.324
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6491–6518
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.324/
DOI:
Bibkey:
Cite (ACL):
Sungmok Jung, Yeonkyoung So, Joonhak Lee, Sangho Kim, Yelim Ahn, and Jaejin Lee. 2026. Thunder-KoNUBench: A Corpus-Aligned Benchmark for Korean Negation Understanding. In Findings of the Association for Computational Linguistics: ACL 2026, pages 6491–6518, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Thunder-KoNUBench: A Corpus-Aligned Benchmark for Korean Negation Understanding (Jung et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.324.pdf
Checklist:
 2026.findings-acl.324.checklist.pdf