A Continuous Approach to Metaphorically Motivated Regular Polysemy in Language Models

Anna Temerko, Marcos Garcia, Pablo Gamallo


Abstract
Linguistic accounts show that a word’s polysemy structure is largely governed by systematic sense alternations that form overarching patterns across the vocabulary. While psycholinguistic studies confirm the psychological validity of regularity in human language processing, in the research on large language models (LLMs) this phenomenon remains largely unaddressed. Revealing models’ sensitivity to systematic sense alternations of polysemous words can give us a better understanding of how LLMs process ambiguity and to what extent they emulate representations in the human mind. For this, we employ the measures of surprisal and semantic similarity as proxies of human judgment on the acceptability of novel senses. We focus on two aspects that have not received much attention previously —metaphorically motivated patterns and the continuous nature of regularity. We find evidence that surprisal from language models represents regularity of polysemic extensions in a human-like way, discriminating between different types of senses and varying regularity degrees, and overall strongly correlating with human acceptability scores.
Anthology ID:
2025.conll-1.28
Volume:
Proceedings of the 29th Conference on Computational Natural Language Learning
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Gemma Boleda, Michael Roth
Venues:
CoNLL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
419–436
Language:
URL:
https://preview.aclanthology.org/transition-to-people-yaml/2025.conll-1.28/
DOI:
10.18653/v1/2025.conll-1.28
Bibkey:
Cite (ACL):
Anna Temerko, Marcos Garcia, and Pablo Gamallo. 2025. A Continuous Approach to Metaphorically Motivated Regular Polysemy in Language Models. In Proceedings of the 29th Conference on Computational Natural Language Learning, pages 419–436, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
A Continuous Approach to Metaphorically Motivated Regular Polysemy in Language Models (Temerko et al., CoNLL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/transition-to-people-yaml/2025.conll-1.28.pdf