Reducing Knowledge Noise for Improved Semantic Analysis in Biomedical Natural Language Processing Applications
Usman Naseem, Surendrabikram Thapa, Qi Zhang, Liang Hu, Anum Masood, Mehwish Nasim
Abstract
Graph-based techniques have gained traction for representing and analyzing data in various natural language processing (NLP) tasks. Knowledge graph-based language representation models have shown promising results in leveraging domain-specific knowledge for NLP tasks, particularly in the biomedical NLP field. However, such models have limitations, including knowledge noise and neglect of contextual relationships, leading to potential semantic errors and reduced accuracy. To address these issues, this paper proposes two novel methods. The first method combines knowledge graph-based language model with nearest-neighbor models to incorporate semantic and category information from neighboring instances. The second method involves integrating knowledge graph-based language model with graph neural networks (GNNs) to leverage feature information from neighboring nodes in the graph. Experiments on relation extraction (RE) and classification tasks in English and Chinese language datasets demonstrate significant performance improvements with both methods, highlighting their potential for enhancing the performance of language models and improving NLP applications in the biomedical domain.- Anthology ID:
- 2023.clinicalnlp-1.32
- Volume:
- Proceedings of the 5th Clinical Natural Language Processing Workshop
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Tristan Naumann, Asma Ben Abacha, Steven Bethard, Kirk Roberts, Anna Rumshisky
- Venue:
- ClinicalNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 272–277
- Language:
- URL:
- https://aclanthology.org/2023.clinicalnlp-1.32
- DOI:
- 10.18653/v1/2023.clinicalnlp-1.32
- Cite (ACL):
- Usman Naseem, Surendrabikram Thapa, Qi Zhang, Liang Hu, Anum Masood, and Mehwish Nasim. 2023. Reducing Knowledge Noise for Improved Semantic Analysis in Biomedical Natural Language Processing Applications. In Proceedings of the 5th Clinical Natural Language Processing Workshop, pages 272–277, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- Reducing Knowledge Noise for Improved Semantic Analysis in Biomedical Natural Language Processing Applications (Naseem et al., ClinicalNLP 2023)
- PDF:
- https://preview.aclanthology.org/emnlp-22-attachments/2023.clinicalnlp-1.32.pdf