EuroVerdict: A Multilingual Dataset for Verdict Generation Against Misinformation

Daniel Russo, Fariba Sadeghi, Stefano Menini, Marco Guerini


Abstract
Misinformation is a global issue that shapes public discourse, influencing opinions and decision-making across various domains. While automated fact-checking (AFC) has become essential in combating misinformation, most work in multilingual settings has focused on claim verification rather than generating explanatory verdicts (i.e. short texts discussing the veracity of the claim), leaving a gap in AFC resources beyond English.To this end, we introduce EuroVerdict, a multilingual dataset designed for verdict generation, covering eight European languages. Developed in collaboration with professional fact-checkers, the dataset comprises claims, manually written verdicts, and supporting evidence, including fact-checking articles and additional secondary sources. We evaluate EuroVerdict with Llama-3.1-8B-Instruct on verdict generation under different settings, varying the prompt language, input article language, and training approach. Our results show that fine-tuning consistently improves performance, with models fine-tuned on original-language articles achieving the highest scores in both automatic and human evaluations. Using articles in a different language from the claim slightly lowers performance; however, pairing them with language-specific prompts improves results. Zero-shot and Chain-of-Thought setups perform worse, reinforcing the benefits of fine-tuning for multilingual verdict generation.
Anthology ID:
2025.findings-acl.853
Volume:
Findings of the Association for Computational Linguistics: ACL 2025
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
16617–16634
Language:
URL:
https://preview.aclanthology.org/display_plenaries/2025.findings-acl.853/
DOI:
Bibkey:
Cite (ACL):
Daniel Russo, Fariba Sadeghi, Stefano Menini, and Marco Guerini. 2025. EuroVerdict: A Multilingual Dataset for Verdict Generation Against Misinformation. In Findings of the Association for Computational Linguistics: ACL 2025, pages 16617–16634, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
EuroVerdict: A Multilingual Dataset for Verdict Generation Against Misinformation (Russo et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/display_plenaries/2025.findings-acl.853.pdf