Semisupervised Neural Proto-Language Reconstruction

Liang Lu, Peirong Xie, David Mortensen


Abstract
Existing work implementing comparative reconstruction of ancestral languages (proto-languages) has usually required full supervision. However, historical reconstruction models are only of practical value if they can be trained with a limited amount of labeled data. We propose a semisupervised historical reconstruction task in which the model is trained on only a small amount of labeled data (cognate sets with proto-forms) and a large amount of unlabeled data (cognate sets without proto-forms). We propose a neural architecture for comparative reconstruction (DPD-BiReconstructor) incorporating an essential insight from linguists’ comparative method: that reconstructed words should not only be reconstructable from their daughter words, but also deterministically transformable back into their daughter words. We show that this architecture is able to leverage unlabeled cognate sets to outperform strong semisupervised baselines on this novel task.
Anthology ID:
2024.acl-long.788
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
14715–14759
Language:
URL:
https://aclanthology.org/2024.acl-long.788
DOI:
10.18653/v1/2024.acl-long.788
Bibkey:
Cite (ACL):
Liang Lu, Peirong Xie, and David Mortensen. 2024. Semisupervised Neural Proto-Language Reconstruction. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14715–14759, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Semisupervised Neural Proto-Language Reconstruction (Lu et al., ACL 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/dois-2013-emnlp/2024.acl-long.788.pdf