mOKB6: A Multilingual Open Knowledge Base Completion Benchmark

Shubham Mittal, Keshav Kolluru, Soumen Chakrabarti, Mausam


Abstract
Automated completion of open knowledge bases (Open KBs), which are constructed from triples of the form (subject phrase, relation phrase, object phrase), obtained via open information extraction (Open IE) system, are useful for discovering novel facts that may not be directly present in the text. However, research in Open KB completion (Open KBC) has so far been limited to resource-rich languages like English. Using the latest advances in multilingual Open IE, we construct the first multilingual Open KBC dataset, called mOKB6, containing facts from Wikipedia in six languages (including English). Improvingthe previous Open KB construction pipeline by doing multilingual coreference resolution andkeeping only entity-linked triples, we create a dense Open KB. We experiment with several models for the task and observe a consistent benefit of combining languages with the help of shared embedding space as well as translations of facts. We also observe that current multilingual models struggle to remember facts seen in languages of different scripts.
Anthology ID:
2023.acl-short.19
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
201–214
Language:
URL:
https://aclanthology.org/2023.acl-short.19
DOI:
10.18653/v1/2023.acl-short.19
Bibkey:
Cite (ACL):
Shubham Mittal, Keshav Kolluru, Soumen Chakrabarti, and Mausam. 2023. mOKB6: A Multilingual Open Knowledge Base Completion Benchmark. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 201–214, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
mOKB6: A Multilingual Open Knowledge Base Completion Benchmark (Mittal et al., ACL 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-5/2023.acl-short.19.pdf
Video:
 https://preview.aclanthology.org/nschneid-patch-5/2023.acl-short.19.mp4