Syntax-based Transfer Learning for the Task of Biomedical Relation Extraction

Joël Legrand, Yannick Toussaint, Chedy Raïssi, Adrien Coulet

Abstract
Transfer learning (TL) proposes to enhance machine learning performance on a problem, by reusing labeled data originally designed for a related problem. In particular, domain adaptation consists, for a specific task, in reusing training data developed for the same task but a distinct domain. This is particularly relevant to the applications of deep learning in Natural Language Processing, because those usually require large annotated corpora that may not exist for the targeted domain, but exist for side domains. In this paper, we experiment with TL for the task of Relation Extraction (RE) from biomedical texts, using the TreeLSTM model. We empirically show the impact of TreeLSTM alone and with domain adaptation by obtaining better performances than the state of the art on two biomedical RE tasks and equal performances for two others, for which few annotated data are available. Furthermore, we propose an analysis of the role that syntactic features may play in TL for RE.
Anthology ID:
W18-5617
Volume:
Proceedings of the Ninth International Workshop on Health Text Mining and Information Analysis
Month:
October
Year:
2018
Address:
Brussels, Belgium
Editors:
Alberto Lavelli, Anne-Lyse Minard, Fabio Rinaldi
Venue:
Louhi
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
149–159
Language:
URL:
https://aclanthology.org/W18-5617
DOI:
10.18653/v1/W18-5617
Bibkey:
Cite (ACL):
Joël Legrand, Yannick Toussaint, Chedy Raïssi, and Adrien Coulet. 2018. Syntax-based Transfer Learning for the Task of Biomedical Relation Extraction. In Proceedings of the Ninth International Workshop on Health Text Mining and Information Analysis, pages 149–159, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
Syntax-based Transfer Learning for the Task of Biomedical Relation Extraction (Legrand et al., Louhi 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/naacl-24-ws-corrections/W18-5617.pdf
PDF Search