TempCaps: A Capsule Network-based Embedding Model for Temporal Knowledge Graph Completion

Guirong Fu, Zhao Meng, Zhen Han, Zifeng Ding, Yunpu Ma, Matthias Schubert, Volker Tresp, Roger Wattenhofer


Abstract
Temporal knowledge graphs store the dynamics of entities and relations during a time period. However, typical temporal knowledge graphs often suffer from incomplete dynamics with missing facts in real-world scenarios. Hence, modeling temporal knowledge graphs to complete the missing facts is important. In this paper, we tackle the temporal knowledge graph completion task by proposing TempCaps, which is a Capsule network-based embedding model for Temporal knowledge graph completion. TempCaps models temporal knowledge graphs by introducing a novel dynamic routing aggregator inspired by Capsule Networks. Specifically, TempCaps builds entity embeddings by dynamically routing retrieved temporal relation and neighbor information. Experimental results demonstrate that TempCaps reaches state-of-the-art performance for temporal knowledge graph completion. Additional analysis also shows that TempCaps is efficient.
Anthology ID:
2022.spnlp-1.3
Volume:
Proceedings of the Sixth Workshop on Structured Prediction for NLP
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Andreas Vlachos, Priyanka Agrawal, André Martins, Gerasimos Lampouras, Chunchuan Lyu
Venue:
spnlp
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
22–31
Language:
URL:
https://aclanthology.org/2022.spnlp-1.3
DOI:
10.18653/v1/2022.spnlp-1.3
Bibkey:
Cite (ACL):
Guirong Fu, Zhao Meng, Zhen Han, Zifeng Ding, Yunpu Ma, Matthias Schubert, Volker Tresp, and Roger Wattenhofer. 2022. TempCaps: A Capsule Network-based Embedding Model for Temporal Knowledge Graph Completion. In Proceedings of the Sixth Workshop on Structured Prediction for NLP, pages 22–31, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
TempCaps: A Capsule Network-based Embedding Model for Temporal Knowledge Graph Completion (Fu et al., spnlp 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-3/2022.spnlp-1.3.pdf
Code
 fuguigui/tempcaps
Data
ICEWS