TaxoPro: A Plug-In LoRA-based Cross-Domain Method for Low-Resource Taxonomy Completion
Hongyuan Xu, Yuhang Niu, Ciyi Liu, Yanlong Wen, Xiaojie Yuan
Abstract
Low-resource taxonomy completion aims to automatically insert new concepts into the existing taxonomy, in which only a few in-domain training samples are available. Recent studies have achieved considerable progress by incorporating prior knowledge from pre-trained language models (PLMs). However, these studies tend to overly rely on such knowledge and neglect the shareable knowledge across different taxonomies. In this paper, we propose TaxoPro, a plug-in LoRA-based cross-domain method, that captures shareable knowledge from the high- resource taxonomy to improve PLM-based low-resource taxonomy completion techniques. To prevent negative interference between domain-specific and domain-shared knowledge, TaxoPro decomposes cross- domain knowledge into domain-shared and domain-specific components, storing them using low-rank matrices (LoRA). Additionally, TaxoPro employs two auxiliary losses to regulate the flow of shareable knowledge. Experimental results demonstrate that TaxoPro improves PLM-based techniques, achieving state-of-the-art performance in completing low-resource taxonomies. Code is available at https://github.com/cyclexu/TaxoPro.- Anthology ID:
- 2025.tacl-1.27
- Volume:
- Transactions of the Association for Computational Linguistics, Volume 13
- Month:
- Year:
- 2025
- Address:
- Cambridge, MA
- Venue:
- TACL
- SIG:
- Publisher:
- MIT Press
- Note:
- Pages:
- 557–576
- Language:
- URL:
- https://preview.aclanthology.org/corrections-2025-07/2025.tacl-1.27/
- DOI:
- 10.1162/tacl_a_00755
- Cite (ACL):
- Hongyuan Xu, Yuhang Niu, Ciyi Liu, Yanlong Wen, and Xiaojie Yuan. 2025. TaxoPro: A Plug-In LoRA-based Cross-Domain Method for Low-Resource Taxonomy Completion. Transactions of the Association for Computational Linguistics, 13:557–576.
- Cite (Informal):
- TaxoPro: A Plug-In LoRA-based Cross-Domain Method for Low-Resource Taxonomy Completion (Xu et al., TACL 2025)
- PDF:
- https://preview.aclanthology.org/corrections-2025-07/2025.tacl-1.27.pdf