Abstract
Knowledge graphs are a versatile framework to encode richly structured data relationships, but it can be challenging to combine these graphs with unstructured data. Methods for retrofitting pre-trained entity representations to the structure of a knowledge graph typically assume that entities are embedded in a connected space and that relations imply similarity. However, useful knowledge graphs often contain diverse entities and relations (with potentially disjoint underlying corpora) which do not accord with these assumptions. To overcome these limitations, we present Functional Retrofitting, a framework that generalizes current retrofitting methods by explicitly modeling pairwise relations. Our framework can directly incorporate a variety of pairwise penalty functions previously developed for knowledge graph completion. Further, it allows users to encode, learn, and extract information about relation semantics. We present both linear and neural instantiations of the framework. Functional Retrofitting significantly outperforms existing retrofitting methods on complex knowledge graphs and loses no accuracy on simpler graphs (in which relations do imply similarity). Finally, we demonstrate the utility of the framework by predicting new drug–disease treatment pairs in a large, complex health knowledge graph.- Anthology ID:
- C18-1205
- Volume:
- Proceedings of the 27th International Conference on Computational Linguistics
- Month:
- August
- Year:
- 2018
- Address:
- Santa Fe, New Mexico, USA
- Editors:
- Emily M. Bender, Leon Derczynski, Pierre Isabelle
- Venue:
- COLING
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2423–2436
- Language:
- URL:
- https://aclanthology.org/C18-1205
- DOI:
- Cite (ACL):
- Ben Lengerich, Andrew Maas, and Christopher Potts. 2018. Retrofitting Distributional Embeddings to Knowledge Graphs with Functional Relations. In Proceedings of the 27th International Conference on Computational Linguistics, pages 2423–2436, Santa Fe, New Mexico, USA. Association for Computational Linguistics.
- Cite (Informal):
- Retrofitting Distributional Embeddings to Knowledge Graphs with Functional Relations (Lengerich et al., COLING 2018)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-2/C18-1205.pdf
- Code
- roaminsight/roamresearch
- Data
- FrameNet