An Adaption of BIOASQ Question Answering dataset for Machine Reading systems by Manual Annotations of Answer Spans.

Sanjay Kamath, Brigitte Grau, Yue Ma


Abstract
BIOASQ Task B Phase B challenge focuses on extracting answers from snippets for a given question. The dataset provided by the organizers contains answers, but not all their variants. Henceforth a manual annotation was performed to extract all forms of correct answers. This article shows the impact of using all occurrences of correct answers for training on the evaluation scores which are improved significantly.
Anthology ID:
W18-5309
Volume:
Proceedings of the 6th BioASQ Workshop A challenge on large-scale biomedical semantic indexing and question answering
Month:
November
Year:
2018
Address:
Brussels, Belgium
Editors:
Ioannis A. Kakadiaris, George Paliouras, Anastasia Krithara
Venue:
BioASQ
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
72–78
Language:
URL:
https://aclanthology.org/W18-5309
DOI:
10.18653/v1/W18-5309
Bibkey:
Cite (ACL):
Sanjay Kamath, Brigitte Grau, and Yue Ma. 2018. An Adaption of BIOASQ Question Answering dataset for Machine Reading systems by Manual Annotations of Answer Spans.. In Proceedings of the 6th BioASQ Workshop A challenge on large-scale biomedical semantic indexing and question answering, pages 72–78, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
An Adaption of BIOASQ Question Answering dataset for Machine Reading systems by Manual Annotations of Answer Spans. (Kamath et al., BioASQ 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/W18-5309.pdf
Data
BioASQSQuAD