CRAFT Shared Tasks 2019 Overview — Integrated Structure, Semantics, and Coreference
William Baumgartner, Michael Bada, Sampo Pyysalo, Manuel R. Ciosici, Negacy Hailu, Harrison Pielke-Lombardo, Michael Regan, Lawrence Hunter
Abstract
As part of the BioNLP Open Shared Tasks 2019, the CRAFT Shared Tasks 2019 provides a platform to gauge the state of the art for three fundamental language processing tasks — dependency parse construction, coreference resolution, and ontology concept identification — over full-text biomedical articles. The structural annotation task requires the automatic generation of dependency parses for each sentence of an article given only the article text. The coreference resolution task focuses on linking coreferring base noun phrase mentions into chains using the symmetrical and transitive identity relation. The ontology concept annotation task involves the identification of concept mentions within text using the classes of ten distinct ontologies in the biomedical domain, both unmodified and augmented with extension classes. This paper provides an overview of each task, including descriptions of the data provided to participants and the evaluation metrics used, and discusses participant results relative to baseline performances for each of the three tasks.- Anthology ID:
- D19-5725
- Volume:
- Proceedings of the 5th Workshop on BioNLP Open Shared Tasks
- Month:
- November
- Year:
- 2019
- Address:
- Hong Kong, China
- Editors:
- Kim Jin-Dong, Nédellec Claire, Bossy Robert, Deléger Louise
- Venue:
- BioNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 174–184
- Language:
- URL:
- https://aclanthology.org/D19-5725
- DOI:
- 10.18653/v1/D19-5725
- Cite (ACL):
- William Baumgartner, Michael Bada, Sampo Pyysalo, Manuel R. Ciosici, Negacy Hailu, Harrison Pielke-Lombardo, Michael Regan, and Lawrence Hunter. 2019. CRAFT Shared Tasks 2019 Overview — Integrated Structure, Semantics, and Coreference. In Proceedings of the 5th Workshop on BioNLP Open Shared Tasks, pages 174–184, Hong Kong, China. Association for Computational Linguistics.
- Cite (Informal):
- CRAFT Shared Tasks 2019 Overview — Integrated Structure, Semantics, and Coreference (Baumgartner et al., BioNLP 2019)
- PDF:
- https://preview.aclanthology.org/alta-23-ingestion/D19-5725.pdf