Minimal Supervision for Morphological Inflection

Omer Goldman, Reut Tsarfaty


Abstract
Neural models for the various flavours of morphological reinflection tasks have proven to be extremely accurate given ample labeled data, yet labeled data may be slow and costly to obtain. In this work we aim to overcome this annotation bottleneck by bootstrapping labeled data from a seed as small as five labeled inflection tables, accompanied by a large bulk of unlabeled text. Our bootstrapping method exploits the orthographic and semantic regularities in morphological systems in a two-phased setup, where word tagging based on analogies is followed by word pairing based on distances. Our experiments with the Paradigm Cell Filling Problem over eight typologically different languages show that in languages with relatively simple morphology, orthographic regularities on their own allow inflection models to achieve respectable accuracy. Combined orthographic and semantic regularities alleviate difficulties with particularly complex morpho-phonological systems. We further show that our bootstrapping methods substantially outperform hallucination-based methods commonly used for overcoming the annotation bottleneck in morphological reinflection tasks.
Anthology ID:
2021.emnlp-main.159
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2078–2088
Language:
URL:
https://aclanthology.org/2021.emnlp-main.159
DOI:
10.18653/v1/2021.emnlp-main.159
Bibkey:
Cite (ACL):
Omer Goldman and Reut Tsarfaty. 2021. Minimal Supervision for Morphological Inflection. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 2078–2088, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Minimal Supervision for Morphological Inflection (Goldman & Tsarfaty, EMNLP 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp-22-attachments/2021.emnlp-main.159.pdf
Video:
 https://preview.aclanthology.org/emnlp-22-attachments/2021.emnlp-main.159.mp4
Code
 onlplab/morphodetection