Aspect-augmented Adversarial Networks for Domain Adaptation

Yuan Zhang, Regina Barzilay, Tommi Jaakkola


Abstract
We introduce a neural method for transfer learning between two (source and target) classification tasks or aspects over the same domain. Rather than training on target labels, we use a few keywords pertaining to source and target aspects indicating sentence relevance instead of document class labels. Documents are encoded by learning to embed and softly select relevant sentences in an aspect-dependent manner. A shared classifier is trained on the source encoded documents and labels, and applied to target encoded documents. We ensure transfer through aspect-adversarial training so that encoded documents are, as sets, aspect-invariant. Experimental results demonstrate that our approach outperforms different baselines and model variants on two datasets, yielding an improvement of 27% on a pathology dataset and 5% on a review dataset.
Anthology ID:
Q17-1036
Volume:
Transactions of the Association for Computational Linguistics, Volume 5
Month:
Year:
2017
Address:
Cambridge, MA
Editors:
Lillian Lee, Mark Johnson, Kristina Toutanova
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
515–528
Language:
URL:
https://aclanthology.org/Q17-1036
DOI:
10.1162/tacl_a_00077
Bibkey:
Cite (ACL):
Yuan Zhang, Regina Barzilay, and Tommi Jaakkola. 2017. Aspect-augmented Adversarial Networks for Domain Adaptation. Transactions of the Association for Computational Linguistics, 5:515–528.
Cite (Informal):
Aspect-augmented Adversarial Networks for Domain Adaptation (Zhang et al., TACL 2017)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-1/Q17-1036.pdf
Video:
 https://preview.aclanthology.org/nschneid-patch-1/Q17-1036.mp4
Code
 yuanzh/aspect_adversarial