Abstract
The availability of openly available textual datasets (“corpora”) with highly accurate manual annotations (“gold standard”) of named entities (e.g. persons, locations, organizations, etc.) is crucial in the training and evaluation of named entity recognition systems. Currently there are only few such datasets available on the web, and even less for texts containing historical spelling variation. The production and subsequent release into the public domain of four such datasets with 100 pages each for the languages Dutch, French, German (including Austrian) as part of the Europeana Newspapers project is expected to contribute to the further development and improvement of named entity recognition systems with a focus on historical content. This paper describes how these datasets were produced, what challenges were encountered in their creation and informs about their final quality and availability.- Anthology ID:
- L16-1689
- Volume:
- Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
- Month:
- May
- Year:
- 2016
- Address:
- Portorož, Slovenia
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 4348–4352
- Language:
- URL:
- https://aclanthology.org/L16-1689
- DOI:
- Cite (ACL):
- Clemens Neudecker. 2016. An Open Corpus for Named Entity Recognition in Historic Newspapers. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 4348–4352, Portorož, Slovenia. European Language Resources Association (ELRA).
- Cite (Informal):
- An Open Corpus for Named Entity Recognition in Historic Newspapers (Neudecker, LREC 2016)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-1/L16-1689.pdf
- Code
- EuropeanaNewspapers/ner-corpora
- Data
- Europeana Newspapers