Learning to Learn to Disambiguate: Meta-Learning for Few-Shot Word Sense Disambiguation
Nithin Holla, Pushkar Mishra, Helen Yannakoudakis, Ekaterina Shutova
Abstract
The success of deep learning methods hinges on the availability of large training datasets annotated for the task of interest. In contrast to human intelligence, these methods lack versatility and struggle to learn and adapt quickly to new tasks, where labeled data is scarce. Meta-learning aims to solve this problem by training a model on a large number of few-shot tasks, with an objective to learn new tasks quickly from a small number of examples. In this paper, we propose a meta-learning framework for few-shot word sense disambiguation (WSD), where the goal is to learn to disambiguate unseen words from only a few labeled instances. Meta-learning approaches have so far been typically tested in an N-way, K-shot classification setting where each task has N classes with K examples per class. Owing to its nature, WSD deviates from this controlled setup and requires the models to handle a large number of highly unbalanced classes. We extend several popular meta-learning approaches to this scenario, and analyze their strengths and weaknesses in this new challenging setting.- Anthology ID:
- 2020.findings-emnlp.405
- Volume:
- Findings of the Association for Computational Linguistics: EMNLP 2020
- Month:
- November
- Year:
- 2020
- Address:
- Online
- Editors:
- Trevor Cohn, Yulan He, Yang Liu
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 4517–4533
- Language:
- URL:
- https://preview.aclanthology.org/Author-page-Marten-During-lu/2020.findings-emnlp.405/
- DOI:
- 10.18653/v1/2020.findings-emnlp.405
- Cite (ACL):
- Nithin Holla, Pushkar Mishra, Helen Yannakoudakis, and Ekaterina Shutova. 2020. Learning to Learn to Disambiguate: Meta-Learning for Few-Shot Word Sense Disambiguation. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 4517–4533, Online. Association for Computational Linguistics.
- Cite (Informal):
- Learning to Learn to Disambiguate: Meta-Learning for Few-Shot Word Sense Disambiguation (Holla et al., Findings 2020)
- PDF:
- https://preview.aclanthology.org/Author-page-Marten-During-lu/2020.findings-emnlp.405.pdf
- Code
- Nithin-Holla/MetaWSD + additional community code
- Data
- GLUE, Word Sense Disambiguation: a Unified Evaluation Framework and Empirical Comparison