Modeling Complex Semantics Relation with Contrastively Fine-Tuned Relational Encoders

Naïm Es-sebbani, Esteban Marquer, Zied Bouraoui


Abstract
Modeling relationships between concepts and entities is essential for many applications. While Large Language Models (LLMs) capture relational and commonsense knowledge effectively, they are computationally expensive and often underperform in tasks requiring efficient relational encoding, such as relation induction, extraction, and information retrieval. Despite advancements in learning relational embeddings, existing methods often fail to capture nuanced representations and the rich semantics needed for high-quality embeddings. In this work, we propose different relational encoders designed to capture diverse relational aspects and semantic properties of entity pairs. Although several datasets exist for training such encoders, they often rely on structured knowledge bases or predefined schemas, which primarily encode simple and static relations. To overcome this limitation, we also introduce a novel dataset generation method leveraging LLMs to create a diverse spectrum of relationships. Our experiments demonstrate the effectiveness of our proposed encoders and the benefits of our generated dataset.
Anthology ID:
2025.acl-long.991
Volume:
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
20259–20288
Language:
URL:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.991/
DOI:
Bibkey:
Cite (ACL):
Naïm Es-sebbani, Esteban Marquer, and Zied Bouraoui. 2025. Modeling Complex Semantics Relation with Contrastively Fine-Tuned Relational Encoders. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 20259–20288, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Modeling Complex Semantics Relation with Contrastively Fine-Tuned Relational Encoders (Es-sebbani et al., ACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.991.pdf