@inproceedings{oktem-etal-2025-correcting,
    title = "Correcting the Tamazight Portions of {FLORES}+ and {OLDI} Seed Datasets",
    author = "Oktem, Alp  and
      Farhi, Mohamed Aymane  and
      Essaidi, Brahim  and
      Jabouja, Naceur  and
      Boudichat, Farida",
    editor = "Haddow, Barry  and
      Kocmi, Tom  and
      Koehn, Philipp  and
      Monz, Christof",
    booktitle = "Proceedings of the Tenth Conference on Machine Translation",
    month = nov,
    year = "2025",
    address = "Suzhou, China",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-emnlp/2025.wmt-1.82/",
    pages = "1072--1080",
    ISBN = "979-8-89176-341-8",
    abstract = "We present the manual correction of the Tamazight portions of the FLORES+ and OLDI Seed datasets to improve the quality of open machine translation resources for the language. These widely used reference corpora contained numerous issues, including mistranslations, orthographic inconsistencies, overuse of loanwords, and non-standard transliterations. Overall, 36{\%} of FLORES+ and 40{\%} of Seed sentences were corrected by expert linguists, with average token divergence of 19{\%} and 25{\%} among changed items. Evaluation of multiple MT systems, including NLLB models and commercial LLM services, showed consistent gains in automated evaluation metrics when using the corrected data. Fine-tuning NLLB-600M on the revised Seed corpus yielded improvements of +6.05 chrF (en{\textrightarrow}zgh) and +2.32 (zgh{\textrightarrow}en), outperforming larger parameter models and LLM providers in en{\textrightarrow}zgh direction."
}