Semantic Alignment across Ancient Egyptian Language Stages via Normalization-Aware Multitask Learning

He Huang


Abstract
We study word-level semantic alignment across four historical stages of Ancient Egyptian. These stages differ in script and orthography, and parallel data are scarce. We jointly train a compact encoder-decoder model with a shared byte-level tokenizer on all four stages, combining masked language modeling (MLM), translation language modeling (TLM), sequence-to-sequence translation, and part-of-speech tagging under a task-aware loss with fixed weights and uncertainty-based scaling. To reduce surface divergence we add Latin transliteration and IPA reconstruction as auxiliary views. We integrate these views through KL-based consistency and through embedding-level fusion. We evaluate alignment quality using pairwise metrics, specifically ROC-AUC and triplet accuracy, on curated Egyptian–English and intra-Egyptian cognate datasets. Translation yields the strongest gains. IPA with KL consistency improves cross-branch alignment, while early fusion demonstrates limited efficacy. Although the overall alignment remains limited, the findings provide a reproducible baseline and practical guidance for modeling historical languages under real constraints. They also show how normalization and task design shape what counts as alignment in typologically distant settings.
Anthology ID:
2026.lrec-main.702
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
8923–8936
Language:
URL:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.702/
DOI:
Bibkey:
Cite (ACL):
He Huang. 2026. Semantic Alignment across Ancient Egyptian Language Stages via Normalization-Aware Multitask Learning. International Conference on Language Resources and Evaluation, main:8923–8936.
Cite (Informal):
Semantic Alignment across Ancient Egyptian Language Stages via Normalization-Aware Multitask Learning (Huang, LREC 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.702.pdf