A Multi-Modal Knowledge Graph for Classical Chinese Poetry
Yuqing Li, Yuxin Zhang, Bin Wu, Ji-Rong Wen, Ruihua Song, Ting Bai
Abstract
Classical Chinese poetry has a long history and is a precious cultural heritage of humankind. Displaying the classical Chinese poetry in a visual way, helps to cross cultural barriers in different countries, making it enjoyable for all the people. In this paper, we construct a multi-modal knowledge graph for classical Chinese poetry (PKG), in which the visual information of words in the poetry are incorporated. Then a multi-modal pre-training language model, PKG-Bert, is proposed to obtain the poetry representation with visual information, which bridges the semantic gap between different modalities. PKG-Bert achieves the state-of-the-art performance on the poetry-image retrieval task, showing the effectiveness of incorporating the multi-modal knowledge. The large-scale multi-modal knowledge graph of classical Chinese poetry will be released to promote the researches in classical Chinese culture area.- Anthology ID:
- 2022.findings-emnlp.171
- Volume:
- Findings of the Association for Computational Linguistics: EMNLP 2022
- Month:
- December
- Year:
- 2022
- Address:
- Abu Dhabi, United Arab Emirates
- Editors:
- Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2318–2326
- Language:
- URL:
- https://aclanthology.org/2022.findings-emnlp.171
- DOI:
- 10.18653/v1/2022.findings-emnlp.171
- Cite (ACL):
- Yuqing Li, Yuxin Zhang, Bin Wu, Ji-Rong Wen, Ruihua Song, and Ting Bai. 2022. A Multi-Modal Knowledge Graph for Classical Chinese Poetry. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 2318–2326, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
- Cite (Informal):
- A Multi-Modal Knowledge Graph for Classical Chinese Poetry (Li et al., Findings 2022)
- PDF:
- https://preview.aclanthology.org/proper-vol2-ingestion/2022.findings-emnlp.171.pdf