Abstract
Neural state-of-the-art sequence-to-sequence (seq2seq) models often do not perform well for small training sets. We address paradigm completion, the morphological task of, given a partial paradigm, generating all missing forms. We propose two new methods for the minimal-resource setting: (i) Paradigm transduction: Since we assume only few paradigms available for training, neural seq2seq models are able to capture relationships between paradigm cells, but are tied to the idiosyncracies of the training set. Paradigm transduction mitigates this problem by exploiting the input subset of inflected forms at test time. (ii) Source selection with high precision (SHIP): Multi-source models which learn to automatically select one or multiple sources to predict a target inflection do not perform well in the minimal-resource setting. SHIP is an alternative to identify a reliable source if training data is limited. On a 52-language benchmark dataset, we outperform the previous state of the art by up to 9.71% absolute accuracy.- Anthology ID:
- D18-1363
- Volume:
- Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
- Month:
- October-November
- Year:
- 2018
- Address:
- Brussels, Belgium
- Editors:
- Ellen Riloff, David Chiang, Julia Hockenmaier, Jun’ichi Tsujii
- Venue:
- EMNLP
- SIG:
- SIGDAT
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 3254–3264
- Language:
- URL:
- https://preview.aclanthology.org/build-pipeline-with-new-library/D18-1363/
- DOI:
- 10.18653/v1/D18-1363
- Cite (ACL):
- Katharina Kann and Hinrich Schütze. 2018. Neural Transductive Learning and Beyond: Morphological Generation in the Minimal-Resource Setting. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 3254–3264, Brussels, Belgium. Association for Computational Linguistics.
- Cite (Informal):
- Neural Transductive Learning and Beyond: Morphological Generation in the Minimal-Resource Setting (Kann & Schütze, EMNLP 2018)
- PDF:
- https://preview.aclanthology.org/build-pipeline-with-new-library/D18-1363.pdf