Semantic Relation Classification via Hierarchical Recurrent Neural Network with Attention

Minguang Xiao, Cong Liu


Abstract
Semantic relation classification remains a challenge in natural language processing. In this paper, we introduce a hierarchical recurrent neural network that is capable of extracting information from raw sentences for relation classification. Our model has several distinctive features: (1) Each sentence is divided into three context subsequences according to two annotated nominals, which allows the model to encode each context subsequence independently so as to selectively focus as on the important context information; (2) The hierarchical model consists of two recurrent neural networks (RNNs): the first one learns context representations of the three context subsequences respectively, and the second one computes semantic composition of these three representations and produces a sentence representation for the relationship classification of the two nominals. (3) The attention mechanism is adopted in both RNNs to encourage the model to concentrate on the important information when learning the sentence representations. Experimental results on the SemEval-2010 Task 8 dataset demonstrate that our model is comparable to the state-of-the-art without using any hand-crafted features.
Anthology ID:
C16-1119
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
1254–1263
Language:
URL:
https://aclanthology.org/C16-1119
DOI:
Bibkey:
Cite (ACL):
Minguang Xiao and Cong Liu. 2016. Semantic Relation Classification via Hierarchical Recurrent Neural Network with Attention. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 1254–1263, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Semantic Relation Classification via Hierarchical Recurrent Neural Network with Attention (Xiao & Liu, COLING 2016)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/C16-1119.pdf
Data
SemEval-2010 Task 8