Assessing the performance of Olelo, a real-time biomedical question answering application
Mariana Neves, Fabian Eckert, Hendrik Folkerts, Matthias Uflacker
Abstract
Question answering (QA) can support physicians and biomedical researchers to find answers to their questions in the scientific literature. Such systems process large collections of documents in real time and include many natural language processing (NLP) procedures. We recently developed Olelo, a QA system for biomedicine which includes various NLP components, such as question processing, document and passage retrieval, answer processing and multi-document summarization. In this work, we present an evaluation of our system on the the fifth BioASQ challenge. We participated with the current state of the application and with an extension based on semantic role labeling that we are currently investigating. In addition to the BioASQ evaluation, we compared our system to other on-line biomedical QA systems in terms of the response time and the quality of the answers.- Anthology ID:
- W17-2344
- Volume:
- BioNLP 2017
- Month:
- August
- Year:
- 2017
- Address:
- Vancouver, Canada,
- Venue:
- BioNLP
- SIG:
- SIGBIOMED
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 342–350
- Language:
- URL:
- https://aclanthology.org/W17-2344
- DOI:
- 10.18653/v1/W17-2344
- Cite (ACL):
- Mariana Neves, Fabian Eckert, Hendrik Folkerts, and Matthias Uflacker. 2017. Assessing the performance of Olelo, a real-time biomedical question answering application. In BioNLP 2017, pages 342–350, Vancouver, Canada,. Association for Computational Linguistics.
- Cite (Informal):
- Assessing the performance of Olelo, a real-time biomedical question answering application (Neves et al., BioNLP 2017)
- PDF:
- https://preview.aclanthology.org/auto-file-uploads/W17-2344.pdf
- Data
- BioASQ