Firas Sabbah
2018
Multi-lingual Argumentative Corpora in English, Turkish, Greek, Albanian, Croatian, Serbian, Macedonian, Bulgarian, Romanian and Arabic
Alfred Sliwa
|
Yuan Ma
|
Ruishen Liu
|
Niravkumar Borad
|
Seyedeh Ziyaei
|
Mina Ghobadi
|
Firas Sabbah
|
Ahmet Aker
Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)
2017
An Extensible Multilingual Open Source Lemmatizer
Ahmet Aker
|
Johann Petrak
|
Firas Sabbah
Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2017
We present GATE DictLemmatizer, a multilingual open source lemmatizer for the GATE NLP framework that currently supports English, German, Italian, French, Dutch, and Spanish, and is easily extensible to other languages. The software is freely available under the LGPL license. The lemmatization is based on the Helsinki Finite-State Transducer Technology (HFST) and lemma dictionaries automatically created from Wiktionary. We evaluate the performance of the lemmatizers against TreeTagger, which is only freely available for research purposes. Our evaluation shows that DictLemmatizer achieves similar or even better results than TreeTagger for languages where there is support from HFST. The performance drops when there is no support from HFST and the entire lemmatization process is based on lemma dictionaries. However, the results are still satisfactory given the fact that DictLemmatizer isopen-source and can be easily extended to other languages. The software for extending the lemmatizer by creating word lists from Wiktionary dictionaries is also freely available as open-source software.
Search
Co-authors
- Ahmet Aker 2
- Johann Petrak 1
- Alfred Sliwa 1
- Yuan Ma 1
- Ruishen Liu 1
- show all...