Neural-Symbolic Commonsense Reasoner with Relation Predictors

Farhad Moghimifar, Lizhen Qu, Terry Yue Zhuo, Gholamreza Haffari, Mahsa Baktashmotlagh


Abstract
Commonsense reasoning aims to incorporate sets of commonsense facts, retrieved from Commonsense Knowledge Graphs (CKG), to draw conclusion about ordinary situations. The dynamic nature of commonsense knowledge postulates models capable of performing multi-hop reasoning over new situations. This feature also results in having large-scale sparse Knowledge Graphs, where such reasoning process is needed to predict relations between new events. However, existing approaches in this area are limited by considering CKGs as a limited set of facts, thus rendering them unfit for reasoning over new unseen situations and events. In this paper, we present a neural-symbolic reasoner, which is capable of reasoning over large-scale dynamic CKGs. The logic rules for reasoning over CKGs are learned during training by our model. In addition to providing interpretable explanation, the learned logic rules help to generalise prediction to newly introduced events. Experimental results on the task of link prediction on CKGs prove the effectiveness of our model by outperforming the state-of-the-art models.
Anthology ID:
2021.acl-short.100
Volume:
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)
Month:
August
Year:
2021
Address:
Online
Editors:
Chengqing Zong, Fei Xia, Wenjie Li, Roberto Navigli
Venues:
ACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
797–802
Language:
URL:
https://aclanthology.org/2021.acl-short.100
DOI:
10.18653/v1/2021.acl-short.100
Bibkey:
Cite (ACL):
Farhad Moghimifar, Lizhen Qu, Terry Yue Zhuo, Gholamreza Haffari, and Mahsa Baktashmotlagh. 2021. Neural-Symbolic Commonsense Reasoner with Relation Predictors. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pages 797–802, Online. Association for Computational Linguistics.
Cite (Informal):
Neural-Symbolic Commonsense Reasoner with Relation Predictors (Moghimifar et al., ACL-IJCNLP 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/dois-2013-emnlp/2021.acl-short.100.pdf
Video:
 https://preview.aclanthology.org/dois-2013-emnlp/2021.acl-short.100.mp4
Data
ConceptNet