Morphemes without Borders: Evaluating Root–Pattern Morphology in Arabic Tokenizers and LLMs

Yara Yousif Alakeel, Chatrine Qwaider, Hanan Aldarmaki, Sawsan Alqahtani


Abstract
This work investigates how effectively large language models (LLMs) and their tokenization schemes represent and generate Arabic root–pattern morphology, probing whether they capture genuine morphological structure or rely on surface memorization. Arabic morphological system provides a rich testbed for analyzing how LLMs handle complex, non-concatenative forms and how tokenization choices influence this process. Our study begins with an evaluation of morphological fidelity across Arabic and multilingual tokenizers against gold-standard segmentation, followed by an analysis of LLM performance in productive root–pattern generation using a newly developed benchmark. Our findings across seven Arabic-centric and multilingual LLMs and their respective tokenizers reveal that tokenizer morphological alignment is not necessary nor sufficient for morphological generation, which questions the role of morphological tokenization in downstream performance.
Anthology ID:
2026.lrec-main.923
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
11787–11799
Language:
URL:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.923/
DOI:
Bibkey:
Cite (ACL):
Yara Yousif Alakeel, Chatrine Qwaider, Hanan Aldarmaki, and Sawsan Alqahtani. 2026. Morphemes without Borders: Evaluating Root–Pattern Morphology in Arabic Tokenizers and LLMs. International Conference on Language Resources and Evaluation, main:11787–11799.
Cite (Informal):
Morphemes without Borders: Evaluating Root–Pattern Morphology in Arabic Tokenizers and LLMs (Alakeel et al., LREC 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.923.pdf