Neural Re-rankers for Evidence Retrieval in the FEVEROUS Task

Mohammed Saeed, Giulio Alfarano, Khai Nguyen, Duc Pham, Raphael Troncy, Paolo Papotti

Abstract
Computational fact-checking has gained a lot of traction in the machine learning and natural language processing communities. A plethora of solutions have been developed, but methods which leverage both structured and unstructured information to detect misinformation are of particular relevance. In this paper, we tackle the FEVEROUS (Fact Extraction and VERification Over Unstructured and Structured information) challenge which consists of an open source baseline system together with a benchmark dataset containing 87,026 verified claims. We extend this baseline model by improving the evidence retrieval module yielding the best evidence F1 score among the competitors in the challenge leaderboard while obtaining an overall FEVEROUS score of 0.20 (5th best ranked system).
Anthology ID:
2021.fever-1.12
Volume:
Proceedings of the Fourth Workshop on Fact Extraction and VERification (FEVER)
Month:
November
Year:
2021
Address:
Dominican Republic
Editors:
Rami Aly, Christos Christodoulopoulos, Oana Cocarascu, Zhijiang Guo, Arpit Mittal, Michael Schlichtkrull, James Thorne, Andreas Vlachos
Venue:
FEVER
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
108–112
Language:
URL:
https://aclanthology.org/2021.fever-1.12
DOI:
10.18653/v1/2021.fever-1.12
Bibkey:
Cite (ACL):
Mohammed Saeed, Giulio Alfarano, Khai Nguyen, Duc Pham, Raphael Troncy, and Paolo Papotti. 2021. Neural Re-rankers for Evidence Retrieval in the FEVEROUS Task. In Proceedings of the Fourth Workshop on Fact Extraction and VERification (FEVER), pages 108–112, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Neural Re-rankers for Evidence Retrieval in the FEVEROUS Task (Saeed et al., FEVER 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/naacl24-info/2021.fever-1.12.pdf
PDF Search