SemEval-2019 Task 12: Toponym Resolution in Scientific Papers

Davy Weissenbacher, Arjun Magge, Karen O’Connor, Matthew Scotch, Graciela Gonzalez-Hernandez

Abstract
We present the SemEval-2019 Task 12 which focuses on toponym resolution in scientific articles. Given an article from PubMed, the task consists of detecting mentions of names of places, or toponyms, and mapping the mentions to their corresponding entries in GeoNames.org, a database of geospatial locations. We proposed three subtasks. In Subtask 1, we asked participants to detect all toponyms in an article. In Subtask 2, given toponym mentions as input, we asked participants to disambiguate them by linking them to entries in GeoNames. In Subtask 3, we asked participants to perform both the detection and the disambiguation steps for all toponyms. A total of 29 teams registered, and 8 teams submitted a system run. We summarize the corpus and the tools created for the challenge. They are freely available at https://competitions.codalab.org/competitions/19948. We also analyze the methods, the results and the errors made by the competing systems with a focus on toponym disambiguation.
Anthology ID:
S19-2155
Volume:
Proceedings of the 13th International Workshop on Semantic Evaluation
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota, USA
Editors:
Jonathan May, Ekaterina Shutova, Aurelie Herbelot, Xiaodan Zhu, Marianna Apidianaki, Saif M. Mohammad
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
907–916
Language:
URL:
https://aclanthology.org/S19-2155
DOI:
10.18653/v1/S19-2155
Bibkey:
Cite (ACL):
Davy Weissenbacher, Arjun Magge, Karen O’Connor, Matthew Scotch, and Graciela Gonzalez-Hernandez. 2019. SemEval-2019 Task 12: Toponym Resolution in Scientific Papers. In Proceedings of the 13th International Workshop on Semantic Evaluation, pages 907–916, Minneapolis, Minnesota, USA. Association for Computational Linguistics.
Cite (Informal):
SemEval-2019 Task 12: Toponym Resolution in Scientific Papers (Weissenbacher et al., SemEval 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/autopr/S19-2155.pdf
PDF Search Fix metadata