Domain Adaptation for Syntactic and Semantic Dependency Parsing Using Deep Belief Networks

Haitong Yang, Tao Zhuang, Chengqing Zong


Abstract
In current systems for syntactic and semantic dependency parsing, people usually define a very high-dimensional feature space to achieve good performance. But these systems often suffer severe performance drops on out-of-domain test data due to the diversity of features of different domains. This paper focuses on how to relieve this domain adaptation problem with the help of unlabeled target domain data. We propose a deep learning method to adapt both syntactic and semantic parsers. With additional unlabeled target domain data, our method can learn a latent feature representation (LFR) that is beneficial to both domains. Experiments on English data in the CoNLL 2009 shared task show that our method largely reduced the performance drop on out-of-domain test data. Moreover, we get a Macro F1 score that is 2.32 points higher than the best system in the CoNLL 2009 shared task in out-of-domain tests.
Anthology ID:
Q15-1020
Volume:
Transactions of the Association for Computational Linguistics, Volume 3
Month:
Year:
2015
Address:
Cambridge, MA
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
271–282
Language:
URL:
https://aclanthology.org/Q15-1020
DOI:
10.1162/tacl_a_00138
Bibkey:
Cite (ACL):
Haitong Yang, Tao Zhuang, and Chengqing Zong. 2015. Domain Adaptation for Syntactic and Semantic Dependency Parsing Using Deep Belief Networks. Transactions of the Association for Computational Linguistics, 3:271–282.
Cite (Informal):
Domain Adaptation for Syntactic and Semantic Dependency Parsing Using Deep Belief Networks (Yang et al., TACL 2015)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/Q15-1020.pdf