Leveraging Capsule Routing to Associate Knowledge with Medical Literature Hierarchically
Xin Liu, Qingcai Chen, Junying Chen, Wenxiu Zhou, Tingyu Liu, Xinlan Yang, Weihua Peng
Abstract
Integrating knowledge into text is a promising way to enrich text representation, especially in the medical field. However, undifferentiated knowledge not only confuses the text representation but also imports unexpected noises. In this paper, to alleviate this problem, we propose leveraging capsule routing to associate knowledge with medical literature hierarchically (called HiCapsRKL). Firstly, HiCapsRKL extracts two empirically designed text fragments from medical literature and encodes them into fragment representations respectively. Secondly, the capsule routing algorithm is applied to two fragment representations. Through the capsule computing and dynamic routing, each representation is processed into a new representation (denoted as caps-representation), and we integrate the caps-representations as information gain to associate knowledge with medical literature hierarchically. Finally, HiCapsRKL are validated on relevance prediction and medical literature retrieval test sets. The experimental results and analyses show that HiCapsRKLcan more accurately associate knowledge with medical literature than mainstream methods. In summary, HiCapsRKL can efficiently help selecting the most relevant knowledge to the medical literature, which may be an alternative attempt to improve knowledge-based text representation. Source code is released on GitHub.- Anthology ID:
- 2021.emnlp-main.285
- Volume:
- Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
- Month:
- November
- Year:
- 2021
- Address:
- Online and Punta Cana, Dominican Republic
- Editors:
- Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 3518–3532
- Language:
- URL:
- https://aclanthology.org/2021.emnlp-main.285
- DOI:
- 10.18653/v1/2021.emnlp-main.285
- Cite (ACL):
- Xin Liu, Qingcai Chen, Junying Chen, Wenxiu Zhou, Tingyu Liu, Xinlan Yang, and Weihua Peng. 2021. Leveraging Capsule Routing to Associate Knowledge with Medical Literature Hierarchically. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 3518–3532, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
- Cite (Informal):
- Leveraging Capsule Routing to Associate Knowledge with Medical Literature Hierarchically (Liu et al., EMNLP 2021)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2021.emnlp-main.285.pdf
- Code
- gdls/hicapsrkl