Abstract
In this paper we present a tagger developed for inflectionally rich languages for which both a training corpus and a lexicon are available. We do not constrain the tagger by the lexicon entries, allowing both for lexicon incompleteness and noisiness. By using the lexicon indirectly through features we allow for known and unknown words to be tagged in the same manner. We test our tagger on Slovene data, obtaining a 25% error reduction of the best previous results both on known and unknown words. Given that Slovene is, in comparison to some other Slavic languages, a well-resourced language, we perform experiments on the impact of token (corpus) vs. type (lexicon) supervision, obtaining useful insights in how to balance the effort of extending resources to yield better tagging results.- Anthology ID:
- L16-1242
- Volume:
- Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
- Month:
- May
- Year:
- 2016
- Address:
- Portorož, Slovenia
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 1527–1531
- Language:
- URL:
- https://aclanthology.org/L16-1242
- DOI:
- Cite (ACL):
- Nikola Ljubešić and Tomaž Erjavec. 2016. Corpus vs. Lexicon Supervision in Morphosyntactic Tagging: the Case of Slovene. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 1527–1531, Portorož, Slovenia. European Language Resources Association (ELRA).
- Cite (Informal):
- Corpus vs. Lexicon Supervision in Morphosyntactic Tagging: the Case of Slovene (Ljubešić & Erjavec, LREC 2016)
- PDF:
- https://preview.aclanthology.org/improve-issue-templates/L16-1242.pdf
- Code
- clarinsi/reldi-tagger