Capability Decomposition for Unified Information Extraction via Hierarchical Mixture-of-Experts

Jing Zhou, Peng Wang, Wenjun Ke, Jiajun Liu, Yao He


Abstract
Unified Information Extraction (UIE) aims to handle heterogeneous IE tasks within a single framework, but existing methods often suffer from inconsistent schema representation, implicitly intermediate reasoning and full-parameter adaptation, which limit generalization, interpretability and parameter efficiency. To address these issues, we propose UC-UIE (Universal Capabilities-based Unified Information Extractor), a unified framework based on Large Language Model (LLM), which introduces a unified frame-and-slots schema for IE tasks and explicitly decomposes IE reasoning into three universal capabilities: judging, locating, and associating. Furthermore, UC-UIE adopts a Low-Rank Adaptation (LoRA) based hierarchical Mixture-of-Experts (MoE) adapter to fine-tune LLMs for IE tasks, which explicitly models these three capabilities in a task-driven way while ensuring parameter efficiency. With only 1.24% trainable parameters, UC-UIE outperforms full-parameter tuning methods, showing excellent parameter efficiency. Zero-shot evaluation reveals its strong generalization ability to unseen domains and schemas, benefiting from unified schema representation and explicit capability decomposition. Further experiments validate that the hierarchical MoE adapter learns capability specialization and composition, which enhances both UIE performance and interpretability.
Anthology ID:
2026.acl-long.561
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12304–12318
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.561/
DOI:
Bibkey:
Cite (ACL):
Jing Zhou, Peng Wang, Wenjun Ke, Jiajun Liu, and Yao He. 2026. Capability Decomposition for Unified Information Extraction via Hierarchical Mixture-of-Experts. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 12304–12318, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Capability Decomposition for Unified Information Extraction via Hierarchical Mixture-of-Experts (Zhou et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.561.pdf
Checklist:
 2026.acl-long.561.checklist.pdf