@inproceedings{baidildinova-etal-2026-quantifying,
    title = "Quantifying mutual intelligibility gradients in {T}urkic languages using language models",
    author = "Baidildinova, Moldir  and
      Upadhye, Shiva  and
      Wagner, Austin  and
      Mayer, Connor  and
      Futrell, Richard",
    editor = "Voigt, Rob  and
      Warstadt, Alex  and
      Feldman, Naomi  and
      Linzen, Tal",
    booktitle = "Proceedings of the Society for Computation in Linguistics 2026",
    month = jul,
    year = "2026",
    address = "San Diego, CA",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-acl-workshops/2026.scil-main.41/",
    pages = "442--446",
    ISBN = "979-8-89176-412-5",
    abstract = "Mutual intelligibility (MI) among related languages is a gradient phenomenon shaped by lexical, grammatical, and phonetic-phonological similarity. This study proposes a neural language modeling approach to quantifying MI patterns within the Turkic language family. Using IPA-transcribed naturalistic text from six Turkic languages, we train character-level LSTM models on a source language and fine-tune them on target languages that vary in genealogical distance. Cross-lingual transfer is evaluated using character-level cross-entropy (CE) loss, Area Under the Curve (AUC), and Rate of Change (ROC), which together capture model generalization, learning dynamics, and early-stage adaptation. We further examine whether model performance is predicted by cophenetic distance, lexical similarity, weighted trigram frequency overlap, and differences in vowel harmony index. Overall, the results suggest that character-level language models can approximate MI gradients across Turkic languages: closely related pairs generally show lower CE loss and smaller AUC, while more distant pairs show greater early-stage change. Lexical similarity, local phonotactic overlap, and genealogical distance appear to be the most informative predictors of model convergence. These findings provide preliminary evidence that neural language models trained on naturalistic text can offer a scalable way to model MI patterns, including directional asymmetries, across closely related languages."
}