ANU-CSIRO at MEDIQA 2019: Question Answering Using Deep Contextual Knowledge

Vincent Nguyen, Sarvnaz Karimi, Zhenchang Xing


Abstract
We report on our system for textual inference and question entailment in the medical domain for the ACL BioNLP 2019 Shared Task, MEDIQA. Textual inference is the task of finding the semantic relationships between pairs of text. Question entailment involves identifying pairs of questions which have similar semantic content. To improve upon medical natural language inference and question entailment approaches to further medical question answering, we propose a system that incorporates open-domain and biomedical domain approaches to improve semantic understanding and ambiguity resolution. Our models achieve 80% accuracy on medical natural language inference (6.5% absolute improvement over the original baseline), 48.9% accuracy on recognising medical question entailment, 0.248 Spearman’s rho for question answering ranking and 68.6% accuracy for question answering classification.
Anthology ID:
W19-5051
Volume:
Proceedings of the 18th BioNLP Workshop and Shared Task
Month:
August
Year:
2019
Address:
Florence, Italy
Editors:
Dina Demner-Fushman, Kevin Bretonnel Cohen, Sophia Ananiadou, Junichi Tsujii
Venue:
BioNLP
SIG:
SIGBIOMED
Publisher:
Association for Computational Linguistics
Note:
Pages:
478–487
Language:
URL:
https://aclanthology.org/W19-5051
DOI:
10.18653/v1/W19-5051
Bibkey:
Cite (ACL):
Vincent Nguyen, Sarvnaz Karimi, and Zhenchang Xing. 2019. ANU-CSIRO at MEDIQA 2019: Question Answering Using Deep Contextual Knowledge. In Proceedings of the 18th BioNLP Workshop and Shared Task, pages 478–487, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
ANU-CSIRO at MEDIQA 2019: Question Answering Using Deep Contextual Knowledge (Nguyen et al., BioNLP 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-2023-videos/W19-5051.pdf