Jointly Identifying and Fixing Inconsistent Readings from Information Extraction Systems

Ankur Padia, Francis Ferraro, Tim Finin


Abstract
Information extraction systems analyze text to produce entities and beliefs, but their output often has errors. In this paper, we analyze the reading consistency of the extracted facts with respect to the text from which they were derived and show how to detect and correct errors. We consider both the scenario when the provenance text is automatically found by an information extraction system and when it is curated by humans. We contrast consistency with credibility; define and explore consistency and repair tasks; and demonstrate a simple yet effective and generalizable model. We analyze these tasks and evaluate this approach on three datasets. Against a strong baseline model, we consistently improve both consistency and repair across three datasets using a simple MLP model with attention and lexical features.
Anthology ID:
2022.deelio-1.5
Volume:
Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures
Month:
May
Year:
2022
Address:
Dublin, Ireland and Online
Editors:
Eneko Agirre, Marianna Apidianaki, Ivan Vulić
Venue:
DeeLIO
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
42–52
Language:
URL:
https://preview.aclanthology.org/bulk-corrections-2025-11-25/2022.deelio-1.5/
DOI:
10.18653/v1/2022.deelio-1.5
Bibkey:
Cite (ACL):
Ankur Padia, Francis Ferraro, and Tim Finin. 2022. Jointly Identifying and Fixing Inconsistent Readings from Information Extraction Systems. In Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures, pages 42–52, Dublin, Ireland and Online. Association for Computational Linguistics.
Cite (Informal):
Jointly Identifying and Fixing Inconsistent Readings from Information Extraction Systems (Padia et al., DeeLIO 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/bulk-corrections-2025-11-25/2022.deelio-1.5.pdf
Video:
 https://preview.aclanthology.org/bulk-corrections-2025-11-25/2022.deelio-1.5.mp4