Abstract
In this paper we present a rule- and lexicon-based system for the recognition of Named Entities (NE) in Serbian newspaper texts that was used to prepare a gold standard annotated with personal names. It was further used to prepare training sets for four different levels of annotation, which were further used to train two Named Entity Recognition (NER) systems: Stanford and spaCy. All obtained models, together with a rule- and lexicon-based system were evaluated on two sample texts: a part of the gold standard and an independent newspaper text of approximately the same size. The results show that rule- and lexicon-based system outperforms trained models in all four scenarios (measured by F1), while Stanford models has the highest precision. All systems obtain best results in recognizing full names, while the recognition of first names only is rather poor. The produced models are incorporated into a Web platform NER&Beyond that provides various NE-related functions.- Anthology ID:
- R19-1122
- Volume:
- Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019)
- Month:
- September
- Year:
- 2019
- Address:
- Varna, Bulgaria
- Editors:
- Ruslan Mitkov, Galia Angelova
- Venue:
- RANLP
- SIG:
- Publisher:
- INCOMA Ltd.
- Note:
- Pages:
- 1060–1068
- Language:
- URL:
- https://aclanthology.org/R19-1122
- DOI:
- 10.26615/978-954-452-056-4_122
- Cite (ACL):
- Branislava Šandrih, Cvetana Krstev, and Ranka Stankovic. 2019. Development and Evaluation of Three Named Entity Recognition Systems for Serbian - The Case of Personal Names. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019), pages 1060–1068, Varna, Bulgaria. INCOMA Ltd..
- Cite (Informal):
- Development and Evaluation of Three Named Entity Recognition Systems for Serbian - The Case of Personal Names (Šandrih et al., RANLP 2019)
- PDF:
- https://preview.aclanthology.org/naacl-24-ws-corrections/R19-1122.pdf