ClaiRE at SemEval-2018 Task 7: Classification of Relations using Embeddings

Lena Hettinger, Alexander Dallmann, Albin Zehe, Thomas Niebler, Andreas Hotho


Abstract
In this paper we describe our system for SemEval-2018 Task 7 on classification of semantic relations in scientific literature for clean (subtask 1.1) and noisy data (subtask 1.2). We compare two models for classification, a C-LSTM which utilizes only word embeddings and an SVM that also takes handcrafted features into account. To adapt to the domain of science we train word embeddings on scientific papers collected from arXiv.org. The hand-crafted features consist of lexical features to model the semantic relations as well as the entities between which the relation holds. Classification of Relations using Embeddings (ClaiRE) achieved an F1 score of 74.89% for the first subtask and 78.39% for the second.
Anthology ID:
S18-1134
Volume:
Proceedings of the 12th International Workshop on Semantic Evaluation
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Venues:
SemEval | *SEM
SIGs:
SIGLEX | SIGSEM
Publisher:
Association for Computational Linguistics
Note:
Pages:
836–841
Language:
URL:
https://aclanthology.org/S18-1134
DOI:
10.18653/v1/S18-1134
Bibkey:
Cite (ACL):
Lena Hettinger, Alexander Dallmann, Albin Zehe, Thomas Niebler, and Andreas Hotho. 2018. ClaiRE at SemEval-2018 Task 7: Classification of Relations using Embeddings. In Proceedings of the 12th International Workshop on Semantic Evaluation, pages 836–841, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
ClaiRE at SemEval-2018 Task 7: Classification of Relations using Embeddings (Hettinger et al., SemEval-*SEM 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/S18-1134.pdf