2025
pdf
bib
abs
Large Language Models for Multilingual Previously Fact-Checked Claim Detection
Ivan Vykopal
|
Matúš Pikuliak
|
Simon Ostermann
|
Tatiana Anikina
|
Michal Gregor
|
Marian Simko
Findings of the Association for Computational Linguistics: EMNLP 2025
In our era of widespread false information, human fact-checkers often face the challenge of duplicating efforts when verifying claims that may have already been addressed in other countries or languages. As false information transcends linguistic boundaries, the ability to automatically detect previously fact-checked claims across languages has become an increasingly important task. This paper presents the first comprehensive evaluation of large language models (LLMs) for multilingual previously fact-checked claim detection. We assess seven LLMs across 20 languages in both monolingual and cross-lingual settings. Our results show that while LLMs perform well for high-resource languages, they struggle with low-resource languages. Moreover, translating original texts into English proved to be beneficial for low-resource languages. These findings highlight the potential of LLMs for multilingual previously fact-checked claim detection and provide a foundation for further research on this promising application of LLMs.
pdf
bib
abs
SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval
Qiwei Peng
|
Robert Moro
|
Michal Gregor
|
Ivan Srba
|
Simon Ostermann
|
Marian Simko
|
Juraj Podrouzek
|
Matúš Mesarčík
|
Jaroslav Kopčan
|
Anders Søgaard
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
The rapid spread of online disinformation presents a global challenge, and machine learning has been widely explored as a potential solution. However, multilingual settings and low-resource languages are often neglected in this field. To address this gap, we conducted a shared task on multilingual claim retrieval at SemEval 2025, aimed at identifying fact-checked claims that match newly encountered claims expressed in social media posts across different languages. The task includes two subtracks: 1) a monolingual track, where social posts and claims are in the same language 2) a crosslingual track, where social posts and claims might be in different languages. A total of 179 participants registered for the task contributing to 52 test submissions. 23 out of 31 teams have submitted their system papers. In this paper, we report the best-performing systems as well as the most common and the most effective approaches across both subtracks. This shared task, along with its dataset and participating systems, provides valuable insights into multilingual claim retrieval and automated fact-checking, supporting future research in this field.
2024
pdf
bib
abs
ExU: AI Models for Examining Multilingual Disinformation Narratives and Understanding their Spread
Jake Vasilakes
|
Zhixue Zhao
|
Michal Gregor
|
Ivan Vykopal
|
Martin Hyben
|
Carolina Scarton
Proceedings of the 25th Annual Conference of the European Association for Machine Translation (Volume 2)
Addressing online disinformation requires analysing narratives across languages to help fact-checkers and journalists sift through large amounts of data. The ExU project focuses on developing AI-based models for multilingual disinformation analysis, addressing the tasks of rumour stance classification and claim retrieval. We describe the ExU project proposal and summarise the results of a user requirements survey regarding the design of tools to support fact-checking.