An Extensible Framework for Verification of Numerical Claims

James Thorne, Andreas Vlachos


Abstract
In this paper we present our automated fact checking system demonstration which we developed in order to participate in the Fast and Furious Fact Check challenge. We focused on simple numerical claims such as “population of Germany in 2015 was 80 million” which comprised a quarter of the test instances in the challenge, achieving 68% accuracy. Our system extends previous work on semantic parsing and claim identification to handle temporal expressions and knowledge bases consisting of multiple tables, while relying solely on automatically generated training data. We demonstrate the extensible nature of our system by evaluating it on relations used in previous work. We make our system publicly available so that it can be used and extended by the community.
Anthology ID:
E17-3010
Volume:
Proceedings of the Software Demonstrations of the 15th Conference of the European Chapter of the Association for Computational Linguistics
Month:
April
Year:
2017
Address:
Valencia, Spain
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
37–40
Language:
URL:
https://aclanthology.org/E17-3010
DOI:
Bibkey:
Cite (ACL):
James Thorne and Andreas Vlachos. 2017. An Extensible Framework for Verification of Numerical Claims. In Proceedings of the Software Demonstrations of the 15th Conference of the European Chapter of the Association for Computational Linguistics, pages 37–40, Valencia, Spain. Association for Computational Linguistics.
Cite (Informal):
An Extensible Framework for Verification of Numerical Claims (Thorne & Vlachos, EACL 2017)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp-22-attachments/E17-3010.pdf