SimilEx: The First Italian Dataset for Sentence Similarity with Natural Language Explanations

Chiara Alzetta, Felice Dell’orletta, Chiara Fazzone, Giulia Venturi


Abstract
Large language models (LLMs) demonstrate great performance in natural language processing and understanding tasks. However, much work remains to enhance their interpretability. Annotated datasets with explanations could be key to addressing this issue, as they enable the development of models that provide human-like explanations for their decisions. In this paper, we introduce the SimilEx dataset, the first Italian dataset reporting human evaluations of similarity between pairs of sentences. For a subset of these pairs, the annotators also provided explanations in natural language for the scores assigned. The SimilEx dataset is valuable for exploring the variability in similarity perception between sentences and for training LLMs to offer human-like explanations for their predictions.
Anthology ID:
2024.clicit-1.4
Volume:
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)
Month:
December
Year:
2024
Address:
Pisa, Italy
Editors:
Felice Dell'Orletta, Alessandro Lenci, Simonetta Montemagni, Rachele Sprugnoli
Venue:
CLiC-it
SIG:
Publisher:
CEUR Workshop Proceedings
Note:
Pages:
20–28
Language:
URL:
https://preview.aclanthology.org/jlcl-multiple-ingestion/2024.clicit-1.4/
DOI:
Bibkey:
Cite (ACL):
Chiara Alzetta, Felice Dell’orletta, Chiara Fazzone, and Giulia Venturi. 2024. SimilEx: The First Italian Dataset for Sentence Similarity with Natural Language Explanations. In Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024), pages 20–28, Pisa, Italy. CEUR Workshop Proceedings.
Cite (Informal):
SimilEx: The First Italian Dataset for Sentence Similarity with Natural Language Explanations (Alzetta et al., CLiC-it 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/jlcl-multiple-ingestion/2024.clicit-1.4.pdf