Hamid Haghdoost
2019
Supervised Morphological Segmentation Using Rich Annotated Lexicon
Ebrahim Ansari
|
Zdeněk Žabokrtský
|
Mohammad Mahmoudi
|
Hamid Haghdoost
|
Jonáš Vidra
Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019)
Morphological segmentation of words is the process of dividing a word into smaller units called morphemes; it is tricky especially when a morphologically rich or polysynthetic language is under question. In this work, we designed and evaluated several Recurrent Neural Network (RNN) based models as well as various other machine learning based approaches for the morphological segmentation task. We trained our models using annotated segmentation lexicons. To evaluate the effect of the training data size on our models, we decided to create a large hand-annotated morphologically segmented corpus of Persian words, which is, to the best of our knowledge, the first and the only segmentation lexicon for the Persian language. In the experimental phase, using the hand-annotated Persian lexicon and two smaller similar lexicons for Czech and Finnish languages, we evaluated the effect of the training data size, different hyper-parameters settings as well as different RNN-based models.
Building a Morphological Network for Persian on Top of a Morpheme-Segmented Lexicon
Hamid Haghdoost
|
Ebrahim Ansari
|
Zdeněk Žabokrtský
|
Mahshid Nikravesh
Proceedings of the Second International Workshop on Resources and Tools for Derivational Morphology
Search