PlanE: Meta Planning of Data, Tuning, and Inference for Extractive-based LLMs

Jiacheng Wang, Weiyan Zhang, Guangya Yu


Abstract
Enhancing the task-specific capabilities of Large Language Models (LLMs) primarily requires substantial instruction-tuning datasets. However, the sheer volume of such data imposes a considerable annotation cost, and a lack of optimization methods for tailoring LLMs to specific tasks persists. To address the above issues, we propose a Planning framework for constructing Extractive-based LLMs called PlanE, which includes data decomposition, instruction tuning, and prompt inference. Additionally, we introduce a Data-Tuning-Inference (DTI) planner, aimed at selecting the optimal base-LLM and its DTI combinations for specific datasets to improve construction efficiency. The experimental results demonstrate the effectiveness of our PlanE from two views: (1) across different datasets using the same base-LLM, and (2) on the same dataset using different base-LLMs. Furthermore, we validate the generalizability of the proposed DTI planner under different optimization objectives. The codes are publicly available at https://github.com/gugugu-469/PlanE.
Anthology ID:
2026.findings-acl.1582
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
31613–31635
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1582/
DOI:
Bibkey:
Cite (ACL):
Jiacheng Wang, Weiyan Zhang, and Guangya Yu. 2026. PlanE: Meta Planning of Data, Tuning, and Inference for Extractive-based LLMs. In Findings of the Association for Computational Linguistics: ACL 2026, pages 31613–31635, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
PlanE: Meta Planning of Data, Tuning, and Inference for Extractive-based LLMs (Wang et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1582.pdf
Checklist:
 2026.findings-acl.1582.checklist.pdf