MMEKG: Multi-modal Event Knowledge Graph towards Universal Representation across Modalities
Yubo Ma, Zehao Wang, Mukai Li, Yixin Cao, Meiqi Chen, Xinze Li, Wenqi Sun, Kunquan Deng, Kun Wang, Aixin Sun, Jing Shao
Abstract
Events are fundamental building blocks of real-world happenings. In this paper, we present a large-scale, multi-modal event knowledge graph named MMEKG. MMEKG unifies different modalities of knowledge via events, which complement and disambiguate each other. Specifically, MMEKG incorporates (i) over 990 thousand concept events with 644 relation types to cover most types of happenings, and (ii) over 863 million instance events connected through 934 million relations, which provide rich contextual information in texts and/or images. To collect billion-scale instance events and relations among them, we additionally develop an efficient yet effective pipeline for textual/visual knowledge extraction system. We also develop an induction strategy to create million-scale concept events and a schema organizing all events and relations in MMEKG. To this end, we also provide a pipeline enabling our system to seamlessly parse texts/images to event graphs and to retrieve multi-modal knowledge at both concept- and instance-levels.- Anthology ID:
- 2022.acl-demo.23
- Volume:
- Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland
- Editors:
- Valerio Basile, Zornitsa Kozareva, Sanja Stajner
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 231–239
- Language:
- URL:
- https://aclanthology.org/2022.acl-demo.23
- DOI:
- 10.18653/v1/2022.acl-demo.23
- Cite (ACL):
- Yubo Ma, Zehao Wang, Mukai Li, Yixin Cao, Meiqi Chen, Xinze Li, Wenqi Sun, Kunquan Deng, Kun Wang, Aixin Sun, and Jing Shao. 2022. MMEKG: Multi-modal Event Knowledge Graph towards Universal Representation across Modalities. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 231–239, Dublin, Ireland. Association for Computational Linguistics.
- Cite (Informal):
- MMEKG: Multi-modal Event Knowledge Graph towards Universal Representation across Modalities (Ma et al., ACL 2022)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-1/2022.acl-demo.23.pdf
- Data
- FrameNet