Modeling Missing Data in Distant Supervision for Information Extraction

Alan Ritter, Luke Zettlemoyer, Mausam, Oren Etzioni


Abstract
Distant supervision algorithms learn information extraction models given only large readily available databases and text collections. Most previous work has used heuristics for generating labeled data, for example assuming that facts not contained in the database are not mentioned in the text, and facts in the database must be mentioned at least once. In this paper, we propose a new latent-variable approach that models missing data. This provides a natural way to incorporate side information, for instance modeling the intuition that text will often mention rare entities which are likely to be missing in the database. Despite the added complexity introduced by reasoning about missing data, we demonstrate that a carefully designed local search approach to inference is very accurate and scales to large datasets. Experiments demonstrate improved performance for binary and unary relation extraction when compared to learning with heuristic labels, including on average a 27% increase in area under the precision recall curve in the binary case.
Anthology ID:
Q13-1030
Volume:
Transactions of the Association for Computational Linguistics, Volume 1
Month:
Year:
2013
Address:
Cambridge, MA
Editors:
Dekang Lin, Michael Collins
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
367–378
Language:
URL:
https://aclanthology.org/Q13-1030
DOI:
10.1162/tacl_a_00234
Bibkey:
Cite (ACL):
Alan Ritter, Luke Zettlemoyer, Mausam, and Oren Etzioni. 2013. Modeling Missing Data in Distant Supervision for Information Extraction. Transactions of the Association for Computational Linguistics, 1:367–378.
Cite (Informal):
Modeling Missing Data in Distant Supervision for Information Extraction (Ritter et al., TACL 2013)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-bitext-workshop/Q13-1030.pdf