Relation-aware Bidirectional Path Reasoning for Commonsense Question Answering

Junxing Wang, Xinyi Li, Zhen Tan, Xiang Zhao, Weidong Xiao


Abstract
Commonsense Question Answering is an important natural language processing (NLP) task that aims to predict the correct answer to a question through commonsense reasoning. Previous studies utilize pre-trained models on large-scale corpora such as BERT, or perform reasoning on knowledge graphs. However, these methods do not explicitly model the relations that connect entities, which are informational and can be used to enhance reasoning. To address this issue, we propose a relation-aware reasoning method. Our method uses a relation-aware graph neural network to capture the rich contextual information from both entities and relations. Compared with methods that use fixed relation embeddings from pre-trained models, our model dynamically updates relations with contextual information from a multi-source subgraph, built from multiple external knowledge sources. The enhanced representations of relations are then fed to a bidirectional reasoning module. A bidirectional attention mechanism is applied between the question sequence and the paths that connect entities, which provides us with transparent interpretability. Experimental results on the CommonsenseQA dataset illustrate that our method results in significant improvements over the baselines while also providing clear reasoning paths.
Anthology ID:
2021.conll-1.35
Volume:
Proceedings of the 25th Conference on Computational Natural Language Learning
Month:
November
Year:
2021
Address:
Online
Venue:
CoNLL
SIG:
SIGNLL
Publisher:
Association for Computational Linguistics
Note:
Pages:
445–453
Language:
URL:
https://aclanthology.org/2021.conll-1.35
DOI:
10.18653/v1/2021.conll-1.35
Bibkey:
Cite (ACL):
Junxing Wang, Xinyi Li, Zhen Tan, Xiang Zhao, and Weidong Xiao. 2021. Relation-aware Bidirectional Path Reasoning for Commonsense Question Answering. In Proceedings of the 25th Conference on Computational Natural Language Learning, pages 445–453, Online. Association for Computational Linguistics.
Cite (Informal):
Relation-aware Bidirectional Path Reasoning for Commonsense Question Answering (Wang et al., CoNLL 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/remove-xml-comments/2021.conll-1.35.pdf
Video:
 https://preview.aclanthology.org/remove-xml-comments/2021.conll-1.35.mp4
Data
CommonsenseQAConceptNet