SenseRel: A Sense-Level Benchmark for Denotational and Connotational Meaning Relations
Pierluigi Cassotti, Naomi Baes, Stefano De Pascale, J\'ader Martins Camboim de S\'a, Francesco Periti, Nick Haslam, Dirk Geeraerts, Nina Tahmasebi
Abstract
Polysemy enables a single word to convey multiple related meanings, reflecting the conceptual and emotional aspects of the evolution of the senses. We introduce the first sense-level benchmark, SenseRel, for modeling semantic relations between word senses, uniting denotational and connotational aspects of meaning. SenseRel distinguishes denotational relations, such as generalization or metaphor, as well as two connotational dimensions: valence and arousal. We evaluate large language models (LLMs), GPT-4o, Llama 3.1, and DeepSeek, in zero-shot and fine-tuned settings. Results show that GPT-4o best aligns with human affective judgments, while a fine-tuned RoBERTa model excels at classifying denotational relations.- Anthology ID:
- 2026.acl-long.20
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 499–515
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.20/
- DOI:
- Cite (ACL):
- Pierluigi Cassotti, Naomi Baes, Stefano De Pascale, J\'ader Martins Camboim de S\'a, Francesco Periti, Nick Haslam, Dirk Geeraerts, and Nina Tahmasebi. 2026. SenseRel: A Sense-Level Benchmark for Denotational and Connotational Meaning Relations. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 499–515, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- SenseRel: A Sense-Level Benchmark for Denotational and Connotational Meaning Relations (Cassotti et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.20.pdf