ClaimCatchers at SemEval-2025 Task 7: Sentence Transformers for Claim Retrieval

Rrubaa Panchendrarajan, Rafael Frade, Arkaitz Zubiaga


Abstract
Retrieving previously fact-checked claims from verified databases has become a crucial area of research in automated fact-checking, given the impracticality of manual verification of massive online content. To address this challenge, SemEval 2025 Task 7 focuses on multilingual previously fact-checked claim retrieval. This paper presents the experiments conducted for this task, evaluating the effectiveness of various sentence transformer models—ranging from 22M to 9B parameters—in conjunction with retrieval strategies such as nearest neighbor search and reranking techniques. Further, we explore the impact of learning context-specific text representation via finetuning these models. Our results demonstrate that smaller and medium-sized models, when optimized with effective finetuning and reranking, can achieve retrieval accuracy comparable to larger models, highlighting their potential for scalable and efficient misinformation detection.
Anthology ID:
2025.semeval-1.63
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
455–462
Language:
URL:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.63/
DOI:
Bibkey:
Cite (ACL):
Rrubaa Panchendrarajan, Rafael Frade, and Arkaitz Zubiaga. 2025. ClaimCatchers at SemEval-2025 Task 7: Sentence Transformers for Claim Retrieval. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 455–462, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
ClaimCatchers at SemEval-2025 Task 7: Sentence Transformers for Claim Retrieval (Panchendrarajan et al., SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.63.pdf