SenseRel: A Sense-Level Benchmark for Denotational and Connotational Meaning Relations

Pierluigi Cassotti, Naomi Baes, Stefano De Pascale, J\'ader Martins Camboim de S\'a, Francesco Periti, Nick Haslam, Dirk Geeraerts, Nina Tahmasebi


Abstract
Polysemy enables a single word to convey multiple related meanings, reflecting the conceptual and emotional aspects of the evolution of the senses. We introduce the first sense-level benchmark, SenseRel, for modeling semantic relations between word senses, uniting denotational and connotational aspects of meaning. SenseRel distinguishes denotational relations, such as generalization or metaphor, as well as two connotational dimensions: valence and arousal. We evaluate large language models (LLMs), GPT-4o, Llama 3.1, and DeepSeek, in zero-shot and fine-tuned settings. Results show that GPT-4o best aligns with human affective judgments, while a fine-tuned RoBERTa model excels at classifying denotational relations.
Anthology ID:
2026.acl-long.20
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
499–515
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.20/
DOI:
Bibkey:
Cite (ACL):
Pierluigi Cassotti, Naomi Baes, Stefano De Pascale, J\'ader Martins Camboim de S\'a, Francesco Periti, Nick Haslam, Dirk Geeraerts, and Nina Tahmasebi. 2026. SenseRel: A Sense-Level Benchmark for Denotational and Connotational Meaning Relations. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 499–515, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
SenseRel: A Sense-Level Benchmark for Denotational and Connotational Meaning Relations (Cassotti et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.20.pdf
Checklist:
 2026.acl-long.20.checklist.pdf