Learning Typed Entailment Graphs with Global Soft Constraints

Mohammad Javad Hosseini, Nathanael Chambers, Siva Reddy, Xavier R. Holt, Shay B. Cohen, Mark Johnson, Mark Steedman


Abstract
This paper presents a new method for learning typed entailment graphs from text. We extract predicate-argument structures from multiple-source news corpora, and compute local distributional similarity scores to learn entailments between predicates with typed arguments (e.g., person contracted disease). Previous work has used transitivity constraints to improve local decisions, but these constraints are intractable on large graphs. We instead propose a scalable method that learns globally consistent similarity scores based on new soft constraints that consider both the structures across typed entailment graphs and inside each graph. Learning takes only a few hours to run over 100K predicates and our results show large improvements over local similarity scores on two entailment data sets. We further show improvements over paraphrases and entailments from the Paraphrase Database, and prior state-of-the-art entailment graphs. We show that the entailment graphs improve performance in a downstream task.
Anthology ID:
Q18-1048
Volume:
Transactions of the Association for Computational Linguistics, Volume 6
Month:
Year:
2018
Address:
Cambridge, MA
Editors:
Lillian Lee, Mark Johnson, Kristina Toutanova, Brian Roark
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
703–717
Language:
URL:
https://aclanthology.org/Q18-1048
DOI:
10.1162/tacl_a_00250
Bibkey:
Cite (ACL):
Mohammad Javad Hosseini, Nathanael Chambers, Siva Reddy, Xavier R. Holt, Shay B. Cohen, Mark Johnson, and Mark Steedman. 2018. Learning Typed Entailment Graphs with Global Soft Constraints. Transactions of the Association for Computational Linguistics, 6:703–717.
Cite (Informal):
Learning Typed Entailment Graphs with Global Soft Constraints (Hosseini et al., TACL 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-2/Q18-1048.pdf
Video:
 https://preview.aclanthology.org/nschneid-patch-2/Q18-1048.mp4
Code
 mjhosseini/entGraph
Data
NewsQA