Skill Weaving: Efficient LLM Improvement via Modular Skillpacks
Zhuo Li, Guodong DU, Zesheng Shi, Weiyang Guo, Weijun Yao, Yuan Zhou, Jiabo Zhang, Jing Li
Abstract
In this work, we introduce SkillWeave, a modular improvement framework that enables large language models to specialize under fixed memory budgets. SkillWeave partitions full capabilities of a general-purpose model into domain-specific skillpacks—lightweight, domain-specific delta modules—that reorganize and refine the model’s internal knowledge. To ensure deployment efficiency, SkillWeave incorporates SkillZip, a compression component that transforms specialized parameters into lightweight, inference-ready skillpacks. Together, these components allow SkillWeave to achieve strong multi-domain performance and inference-efficient execution. On multi-task and agentic benchmarks, a 9B SkillWeave model outperforms task-specific baselines and even surpasses a 32B monolithic LLM, while achieving up to 4× speedup.- Anthology ID:
- 2026.findings-acl.1989
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 40000–40023
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1989/
- DOI:
- Cite (ACL):
- Zhuo Li, Guodong DU, Zesheng Shi, Weiyang Guo, Weijun Yao, Yuan Zhou, Jiabo Zhang, and Jing Li. 2026. Skill Weaving: Efficient LLM Improvement via Modular Skillpacks. In Findings of the Association for Computational Linguistics: ACL 2026, pages 40000–40023, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- Skill Weaving: Efficient LLM Improvement via Modular Skillpacks (Li et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1989.pdf