DoSSIER at MedVidQA 2022: Text-based Approaches to Medical Video Answer Localization Problem
Wojciech Kusa, Georgios Peikos, Óscar Espitia, Allan Hanbury, Gabriella Pasi
Abstract
This paper describes our contribution to the Answer Localization track of the MedVidQA 2022 Shared Task. We propose two answer localization approaches that use only textual information extracted from the video. In particular, our approaches exploit the text extracted from the video’s transcripts along with the text displayed in the video’s frames to create a set of features. Having created a set of features that represents a video’s textual information, we employ four different models to measure the similarity between a video’s segment and a corresponding question. Then, we employ two different methods to obtain the start and end times of the identified answer. One of them is based on a random forest regressor, whereas the other one uses an unsupervised peak detection model to detect the answer’s start time. Our findings suggest that for this task, leveraging only text-related features (transmitted either verbally or visually) and using a small amount of training data, lead to significant improvements over the benchmark Video Span Localization model that is based on deep neural networks.- Anthology ID:
- 2022.bionlp-1.43
- Volume:
- Proceedings of the 21st Workshop on Biomedical Language Processing
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland
- Editors:
- Dina Demner-Fushman, Kevin Bretonnel Cohen, Sophia Ananiadou, Junichi Tsujii
- Venue:
- BioNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 432–440
- Language:
- URL:
- https://aclanthology.org/2022.bionlp-1.43
- DOI:
- 10.18653/v1/2022.bionlp-1.43
- Cite (ACL):
- Wojciech Kusa, Georgios Peikos, Óscar Espitia, Allan Hanbury, and Gabriella Pasi. 2022. DoSSIER at MedVidQA 2022: Text-based Approaches to Medical Video Answer Localization Problem. In Proceedings of the 21st Workshop on Biomedical Language Processing, pages 432–440, Dublin, Ireland. Association for Computational Linguistics.
- Cite (Informal):
- DoSSIER at MedVidQA 2022: Text-based Approaches to Medical Video Answer Localization Problem (Kusa et al., BioNLP 2022)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-3/2022.bionlp-1.43.pdf
- Code
- projectdossier/medvid2022
- Data
- MedVidQA