m-Networks: Adapting the Triplet Networks for Acronym Disambiguation
Sandaru Seneviratne, Elena Daskalaki, Artem Lenskiy, Hanna Suominen
Abstract
Acronym disambiguation (AD) is the process of identifying the correct expansion of the acronyms in text. AD is crucial in natural language understanding of scientific and medical documents due to the high prevalence of technical acronyms and the possible expansions. Given that natural language is often ambiguous with more than one meaning for words, identifying the correct expansion for acronyms requires learning of effective representations for words, phrases, acronyms, and abbreviations based on their context. In this paper, we proposed an approach to leverage the triplet networks and triplet loss which learns better representations of text through distance comparisons of embeddings. We tested both the triplet network-based method and the modified triplet network-based method with m networks on the AD dataset from the SDU@AAAI-21 AD task, CASI dataset, and MeDAL dataset. F scores of 87.31%, 70.67%, and 75.75% were achieved by the m network-based approach for SDU, CASI, and MeDAL datasets respectively indicating that triplet network-based methods have comparable performance but with only 12% of the number of parameters in the baseline method. This effective implementation is available at https://github.com/sandaruSen/m_networks under the MIT license.- Anthology ID:
- 2022.clinicalnlp-1.3
- Volume:
- Proceedings of the 4th Clinical Natural Language Processing Workshop
- Month:
- July
- Year:
- 2022
- Address:
- Seattle, WA
- Editors:
- Tristan Naumann, Steven Bethard, Kirk Roberts, Anna Rumshisky
- Venue:
- ClinicalNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 21–29
- Language:
- URL:
- https://aclanthology.org/2022.clinicalnlp-1.3
- DOI:
- 10.18653/v1/2022.clinicalnlp-1.3
- Cite (ACL):
- Sandaru Seneviratne, Elena Daskalaki, Artem Lenskiy, and Hanna Suominen. 2022. m-Networks: Adapting the Triplet Networks for Acronym Disambiguation. In Proceedings of the 4th Clinical Natural Language Processing Workshop, pages 21–29, Seattle, WA. Association for Computational Linguistics.
- Cite (Informal):
- m-Networks: Adapting the Triplet Networks for Acronym Disambiguation (Seneviratne et al., ClinicalNLP 2022)
- PDF:
- https://preview.aclanthology.org/emnlp-22-attachments/2022.clinicalnlp-1.3.pdf
- Data
- MeDAL