FaBULOUS: Fact-checking Based on Understanding of Language Over Unstructured and Structured information
Mostafa Bouziane, Hugo Perrin, Amine Sadeq, Thanh Nguyen, Aurélien Cluzeau, Julien Mardas
Abstract
As part of the FEVEROUS shared task, we developed a robust and finely tuned architecture to handle the joint retrieval and entailment on text data as well as structured data like tables. We proposed two training schemes to tackle the hurdles inherent to multi-hop multi-modal datasets. The first one allows having a robust retrieval of full evidence sets, while the second one enables entailment to take full advantage of noisy evidence inputs. In addition, our work has revealed important insights and potential avenue of research for future improvement on this kind of dataset. In preliminary evaluation on the FEVEROUS shared task test set, our system achieves 0.271 FEVEROUS score, with 0.4258 evidence recall and 0.5607 entailment accuracy.- Anthology ID:
- 2021.fever-1.4
- Volume:
- Proceedings of the Fourth Workshop on Fact Extraction and VERification (FEVER)
- Month:
- November
- Year:
- 2021
- Address:
- Dominican Republic
- Editors:
- Rami Aly, Christos Christodoulopoulos, Oana Cocarascu, Zhijiang Guo, Arpit Mittal, Michael Schlichtkrull, James Thorne, Andreas Vlachos
- Venue:
- FEVER
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 31–39
- Language:
- URL:
- https://aclanthology.org/2021.fever-1.4
- DOI:
- 10.18653/v1/2021.fever-1.4
- Cite (ACL):
- Mostafa Bouziane, Hugo Perrin, Amine Sadeq, Thanh Nguyen, Aurélien Cluzeau, and Julien Mardas. 2021. FaBULOUS: Fact-checking Based on Understanding of Language Over Unstructured and Structured information. In Proceedings of the Fourth Workshop on Fact Extraction and VERification (FEVER), pages 31–39, Dominican Republic. Association for Computational Linguistics.
- Cite (Informal):
- FaBULOUS: Fact-checking Based on Understanding of Language Over Unstructured and Structured information (Bouziane et al., FEVER 2021)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/2021.fever-1.4.pdf
- Data
- FEVEROUS