Non-literal Meaning Representation in the Brain during Naturalistic Listening

Zhengwu Ma, Yuhan Huang, Chengcheng Wang, Jixing Li


Abstract
Naturalistic language comprehension often involves interpretations that go beyond literal meaning. In continuous narratives, literal and non-literal meanings are tightly intertwined, making them difficult to distinguish computationally. Here, we combined literal sentence representations and human-annotated non-literal interpretations for model-brain alignment. Using fMRI data recorded during passive listening to the Chinese version of The Little Prince, we annotated sentences containing non-literal meaning with human-written interpretations of their implied meaning. We then derived the literal and non-literal representations from LLaMA3.1-8B and evaluated their correspondence with neural activity using whole-brain encoding models. Literal representations aligned strongly with left-lateralized frontotemporal regions, whereas non-literal interpretations showed broader right-hemisphere involvement. Combining the two further improved encoding performance in the bilateral temporal and dorsal frontal cortices, suggesting that naturalistic comprehension engages complementary levels of meaning.
Anthology ID:
2026.scil-main.22
Volume:
Proceedings of the Society for Computation in Linguistics 2026
Month:
July
Year:
2026
Address:
San Diego, CA
Editors:
Rob Voigt, Alex Warstadt, Naomi Feldman, Tal Linzen
Venues:
SCiL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
244–257
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.scil-main.22/
DOI:
Bibkey:
Cite (ACL):
Zhengwu Ma, Yuhan Huang, Chengcheng Wang, and Jixing Li. 2026. Non-literal Meaning Representation in the Brain during Naturalistic Listening. In Proceedings of the Society for Computation in Linguistics 2026, pages 244–257, San Diego, CA. Association for Computational Linguistics.
Cite (Informal):
Non-literal Meaning Representation in the Brain during Naturalistic Listening (Ma et al., SCiL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.scil-main.22.pdf