@inproceedings{el-kholy-habash-2010-orthographic,
    title = "Orthographic and Morphological Processing for {E}nglish-{A}rabic Statistical Machine Translation",
    author = "El Kholy, Ahmed  and
      Habash, Nizar",
    editor = "Langlais, Philippe  and
      Gagnon, Michel",
    booktitle = "Actes de la 17e conf{\'e}rence sur le Traitement Automatique des Langues Naturelles. Articles longs",
    month = jul,
    year = "2010",
    address = "Montr{\'e}al, Canada",
    publisher = "ATALA",
    url = "https://preview.aclanthology.org/add-emnlp-2024-awards/2010.jeptalnrecital-long.29/",
    pages = "282--291",
    abstract = "Much of the work on Statistical Machine Translation (SMT) from morphologically rich languages has shown that morphological tokenization and orthographic normalization help improve SMT quality because of the sparsity reduction they contribute. In this paper, we study the effect of these processes on SMT when translating into a morphologically rich language, namely Arabic. We explore a space of tokenization schemes and normalization options. We only evaluate on detokenized and orthographically correct (enriched) output. Our results show that the best performing tokenization scheme is that of the Penn Arabic Treebank. Additionally, training on orthographically normalized (reduced) text then jointly enriching and detokenizing the output outperforms training on enriched text."
}