Ab Antiquo: Neural Proto-language Reconstruction

Carlo Meloni, Shauli Ravfogel, Yoav Goldberg


Abstract
Historical linguists have identified regularities in the process of historic sound change. The comparative method utilizes those regularities to reconstruct proto-words based on observed forms in daughter languages. Can this process be efficiently automated? We address the task of proto-word reconstruction, in which the model is exposed to cognates in contemporary daughter languages, and has to predict the proto word in the ancestor language. We provide a novel dataset for this task, encompassing over 8,000 comparative entries, and show that neural sequence models outperform conventional methods applied to this task so far. Error analysis reveals a variability in the ability of neural model to capture different phonological changes, correlating with the complexity of the changes. Analysis of learned embeddings reveals the models learn phonologically meaningful generalizations, corresponding to well-attested phonological shifts documented by historical linguistics.
Anthology ID:
2021.naacl-main.353
Volume:
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Month:
June
Year:
2021
Address:
Online
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4460–4473
Language:
URL:
https://aclanthology.org/2021.naacl-main.353
DOI:
10.18653/v1/2021.naacl-main.353
Bibkey:
Cite (ACL):
Carlo Meloni, Shauli Ravfogel, and Yoav Goldberg. 2021. Ab Antiquo: Neural Proto-language Reconstruction. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 4460–4473, Online. Association for Computational Linguistics.
Cite (Informal):
Ab Antiquo: Neural Proto-language Reconstruction (Meloni et al., NAACL 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-url/2021.naacl-main.353.pdf
Video:
 https://preview.aclanthology.org/author-url/2021.naacl-main.353.mp4
Code
 shauli-ravfogel/Latin-Reconstruction-NAACL +  additional community code