Abstract
In this paper a Moses SMT toolkit-based language-independent complete morphological annotation tool is presented called HuLaPos2. Our system performs PoS tagging and lemmatization simultaneously. Amongst others, the algorithm used is able to handle phrases instead of unigrams, and can perform the tagging in a not strictly left-to-right order. With utilizing these gains, our system outperforms the HMM-based ones. In order to handle the unknown words, a suffix-tree based guesser was integrated into HuLaPos2. To demonstrate the performance of our system it was compared with several systems in different languages and PoS tag sets. In general, it can be concluded that the quality of HuLaPos2 is comparable with the state-of-the-art systems, and in the case of PoS tagging it outperformed many available systems.- Anthology ID:
- L14-1275
- Volume:
- Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
- Month:
- May
- Year:
- 2014
- Address:
- Reykjavik, Iceland
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 1625–1630
- Language:
- URL:
- http://www.lrec-conf.org/proceedings/lrec2014/pdf/309_Paper.pdf
- DOI:
- Cite (ACL):
- László Laki and György Orosz. 2014. An efficient language independent toolkit for complete morphological disambiguation. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 1625–1630, Reykjavik, Iceland. European Language Resources Association (ELRA).
- Cite (Informal):
- An efficient language independent toolkit for complete morphological disambiguation (Laki & Orosz, LREC 2014)
- PDF:
- http://www.lrec-conf.org/proceedings/lrec2014/pdf/309_Paper.pdf