Unsupervised Learning of Turkish Morphology with Multiple Codebook VQ-VAE

Müge Kural, Deniz Yuret


Abstract
This paper presents an interpretable unsupervised morphological learning model, showing comparable performance to supervised models in learning complex morphological rules of Turkish as evidenced by its application to the problem of morphological inflection within the SIGMORPHON Shared Tasks. The significance of our unsupervised approach lies in its alignment with how humans naturally acquire rules from raw data without supervision. To achieve this, we construct a model with multiple codebooks of VQ-VAE employing continuous and discrete latent variables during word generation. We evaluate the model’s performance under high and low-resource scenarios, and use probing techniques to examine encoded information in latent representations. We also evaluate its generalization capabilities by testing unseen suffixation scenarios within the SIGMORPHON-UniMorph 2022 Shared Task 0. Our results demonstrate our model’s ability to distinguish word structures into lemmas and suffixes, with each codebook specialized for different morphological features, contributing to the interpretability of our model and effectively performing morphological inflection on both seen and unseen morphological features.
Anthology ID:
2024.sigturk-1.1
Volume:
Proceedings of the First Workshop on Natural Language Processing for Turkic Languages (SIGTURK 2024)
Month:
August
Year:
2024
Address:
Bangkok, Thailand and Online
Editors:
Duygu Ataman, Mehmet Oguz Derin, Sardana Ivanova, Abdullatif Köksal, Jonne Sälevä, Deniz Zeyrek
Venues:
SIGTURK | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–17
Language:
URL:
https://aclanthology.org/2024.sigturk-1.1
DOI:
Bibkey:
Cite (ACL):
Müge Kural and Deniz Yuret. 2024. Unsupervised Learning of Turkish Morphology with Multiple Codebook VQ-VAE. In Proceedings of the First Workshop on Natural Language Processing for Turkic Languages (SIGTURK 2024), pages 1–17, Bangkok, Thailand and Online. Association for Computational Linguistics.
Cite (Informal):
Unsupervised Learning of Turkish Morphology with Multiple Codebook VQ-VAE (Kural & Yuret, SIGTURK-WS 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/autopr/2024.sigturk-1.1.pdf