Text Augmented Open Knowledge Graph Completion via Pre-Trained Language Models
Pengcheng Jiang, Shivam Agarwal, Bowen Jin, Xuan Wang, Jimeng Sun, Jiawei Han
Abstract
The mission of open knowledge graph (KG) completion is to draw new findings from known facts. Existing works that augment KG completion require either (1) factual triples to enlarge the graph reasoning space or (2) manually designed prompts to extract knowledge from a pre-trained language model (PLM), exhibiting limited performance and requiring expensive efforts from experts. To this end, we propose TagReal that automatically generates quality query prompts and retrieves support information from large text corpora to probe knowledge from PLM for KG completion. The results show that TagReal achieves state-of-the-art performance on two benchmark datasets. We find that TagReal has superb performance even with limited training data, outperforming existing embedding-based, graph-based, and PLM-based methods.- Anthology ID:
- 2023.findings-acl.709
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2023
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 11161–11180
- Language:
- URL:
- https://aclanthology.org/2023.findings-acl.709
- DOI:
- 10.18653/v1/2023.findings-acl.709
- Cite (ACL):
- Pengcheng Jiang, Shivam Agarwal, Bowen Jin, Xuan Wang, Jimeng Sun, and Jiawei Han. 2023. Text Augmented Open Knowledge Graph Completion via Pre-Trained Language Models. In Findings of the Association for Computational Linguistics: ACL 2023, pages 11161–11180, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- Text Augmented Open Knowledge Graph Completion via Pre-Trained Language Models (Jiang et al., Findings 2023)
- PDF:
- https://preview.aclanthology.org/ingest-bitext-workshop/2023.findings-acl.709.pdf