Abstract
Knowledge Graph (KG) embedding has emerged as a very active area of research over the last few years, resulting in the development of several embedding methods. These KG embedding methods represent KG entities and relations as vectors in a high-dimensional space. Despite this popularity and effectiveness of KG embeddings in various tasks (e.g., link prediction), geometric understanding of such embeddings (i.e., arrangement of entity and relation vectors in vector space) is unexplored – we fill this gap in the paper. We initiate a study to analyze the geometry of KG embeddings and correlate it with task performance and other hyperparameters. To the best of our knowledge, this is the first study of its kind. Through extensive experiments on real-world datasets, we discover several insights. For example, we find that there are sharp differences between the geometry of embeddings learnt by different classes of KG embeddings methods. We hope that this initial study will inspire other follow-up research on this important but unexplored problem.- Anthology ID:
- P18-1012
- Volume:
- Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2018
- Address:
- Melbourne, Australia
- Editors:
- Iryna Gurevych, Yusuke Miyao
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 122–131
- Language:
- URL:
- https://aclanthology.org/P18-1012
- DOI:
- 10.18653/v1/P18-1012
- Cite (ACL):
- Chandrahas, Aditya Sharma, and Partha Talukdar. 2018. Towards Understanding the Geometry of Knowledge Graph Embeddings. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 122–131, Melbourne, Australia. Association for Computational Linguistics.
- Cite (Informal):
- Towards Understanding the Geometry of Knowledge Graph Embeddings (Chandrahas et al., ACL 2018)
- PDF:
- https://preview.aclanthology.org/fix-dup-bibkey/P18-1012.pdf
- Code
- malllabiisc/kg-geometry