Does Multi-Task Learning Always Help?: An Evaluation on Health Informatics
Aditya Joshi, Sarvnaz Karimi, Ross Sparks, Cecile Paris, C Raina MacIntyre
Abstract
Multi-Task Learning (MTL) has been an attractive approach to deal with limited labeled datasets or leverage related tasks, for a variety of NLP problems. We examine the benefit of MTL for three specific pairs of health informatics tasks that deal with: (a) overlapping symptoms for the same classification problem (personal health mention classification for influenza and for a set of symptoms); (b) overlapping medical concepts for related classification problems (vaccine usage and drug usage detection); and, (c) related classification problems (vaccination intent and vaccination relevance detection). We experiment with a simple neural architecture: a shared layer followed by task-specific dense layers. The novelty of this work is that it compares alternatives for shared layers for these pairs of tasks. While our observations agree with the promise of MTL as compared to single-task learning, for health informatics, we show that the benefit also comes with caveats in terms of the choice of shared layers and the relatedness between the participating tasks.- Anthology ID:
- U19-1020
- Volume:
- Proceedings of the 17th Annual Workshop of the Australasian Language Technology Association
- Month:
- 4--6 December
- Year:
- 2019
- Address:
- Sydney, Australia
- Editors:
- Meladel Mistica, Massimo Piccardi, Andrew MacKinlay
- Venue:
- ALTA
- SIG:
- Publisher:
- Australasian Language Technology Association
- Note:
- Pages:
- 151–158
- Language:
- URL:
- https://aclanthology.org/U19-1020
- DOI:
- Cite (ACL):
- Aditya Joshi, Sarvnaz Karimi, Ross Sparks, Cecile Paris, and C Raina MacIntyre. 2019. Does Multi-Task Learning Always Help?: An Evaluation on Health Informatics. In Proceedings of the 17th Annual Workshop of the Australasian Language Technology Association, pages 151–158, Sydney, Australia. Australasian Language Technology Association.
- Cite (Informal):
- Does Multi-Task Learning Always Help?: An Evaluation on Health Informatics (Joshi et al., ALTA 2019)
- PDF:
- https://preview.aclanthology.org/ml4al-ingestion/U19-1020.pdf