TempCaps: A Capsule Network-based Embedding Model for Temporal Knowledge Graph Completion
Guirong Fu, Zhao Meng, Zhen Han, Zifeng Ding, Yunpu Ma, Matthias Schubert, Volker Tresp, Roger Wattenhofer
Abstract
Temporal knowledge graphs store the dynamics of entities and relations during a time period. However, typical temporal knowledge graphs often suffer from incomplete dynamics with missing facts in real-world scenarios. Hence, modeling temporal knowledge graphs to complete the missing facts is important. In this paper, we tackle the temporal knowledge graph completion task by proposing TempCaps, which is a Capsule network-based embedding model for Temporal knowledge graph completion. TempCaps models temporal knowledge graphs by introducing a novel dynamic routing aggregator inspired by Capsule Networks. Specifically, TempCaps builds entity embeddings by dynamically routing retrieved temporal relation and neighbor information. Experimental results demonstrate that TempCaps reaches state-of-the-art performance for temporal knowledge graph completion. Additional analysis also shows that TempCaps is efficient.- Anthology ID:
- 2022.spnlp-1.3
- Volume:
- Proceedings of the Sixth Workshop on Structured Prediction for NLP
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland
- Editors:
- Andreas Vlachos, Priyanka Agrawal, André Martins, Gerasimos Lampouras, Chunchuan Lyu
- Venue:
- spnlp
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 22–31
- Language:
- URL:
- https://aclanthology.org/2022.spnlp-1.3
- DOI:
- 10.18653/v1/2022.spnlp-1.3
- Cite (ACL):
- Guirong Fu, Zhao Meng, Zhen Han, Zifeng Ding, Yunpu Ma, Matthias Schubert, Volker Tresp, and Roger Wattenhofer. 2022. TempCaps: A Capsule Network-based Embedding Model for Temporal Knowledge Graph Completion. In Proceedings of the Sixth Workshop on Structured Prediction for NLP, pages 22–31, Dublin, Ireland. Association for Computational Linguistics.
- Cite (Informal):
- TempCaps: A Capsule Network-based Embedding Model for Temporal Knowledge Graph Completion (Fu et al., spnlp 2022)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/2022.spnlp-1.3.pdf
- Code
- fuguigui/tempcaps
- Data
- ICEWS