Killing Four Birds with Two Stones: Multi-Task Learning for Non-Literal Language Detection

Erik-Lân Do Dinh, Steffen Eger, Iryna Gurevych


Abstract
Non-literal language phenomena such as idioms or metaphors are commonly studied in isolation from each other in NLP. However, often similar definitions and features are being used for different phenomena, challenging the distinction. Instead, we propose to view the detection problem as a generalized non-literal language classification problem. In this paper we investigate multi-task learning for related non-literal language phenomena. We show that in contrast to simply joining the data of multiple tasks, multi-task learning consistently improves upon four metaphor and idiom detection tasks in two languages, English and German. Comparing two state-of-the-art multi-task learning architectures, we also investigate when soft parameter sharing and learned information flow can be beneficial for our related tasks. We make our adapted code publicly available.
Anthology ID:
C18-1132
Volume:
Proceedings of the 27th International Conference on Computational Linguistics
Month:
August
Year:
2018
Address:
Santa Fe, New Mexico, USA
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1558–1569
Language:
URL:
https://aclanthology.org/C18-1132
DOI:
Bibkey:
Cite (ACL):
Erik-Lân Do Dinh, Steffen Eger, and Iryna Gurevych. 2018. Killing Four Birds with Two Stones: Multi-Task Learning for Non-Literal Language Detection. In Proceedings of the 27th International Conference on Computational Linguistics, pages 1558–1569, Santa Fe, New Mexico, USA. Association for Computational Linguistics.
Cite (Informal):
Killing Four Birds with Two Stones: Multi-Task Learning for Non-Literal Language Detection (Do Dinh et al., COLING 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/C18-1132.pdf
Code
 UKPLab/coling2018-nonliteral-mtl