Invocation Refiner: A Plug-and-Play Module for Rectifying LLM Tool Invocations

Qirui Jiao, Dian Jiao, Nan Du, Ying Shen, Liang Lin


Abstract
Large Language Models (LLMs) have shown remarkable capabilities in Tool-Integrated Reasoning (TIR). However, the practical application is often hindered by frequent errors in tool invocations, such as incorrect parameters or malformed formats. Prevailing training paradigms, such as Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), can mitigate these issues but require modification on the base LLM. This lack of modularity necessitates extensive retraining when deploying the system across different base models. To address the limitation, we introduce the Invocation Refiner, a specialized post-processing module designed to enhance the tool-use reliability of base LLMs without directly training on them. The Refiner takes the output from a frozen upstream LLM and the user’s query as input, performing independent reasoning to rectify the invocation. We construct a dedicated training dataset and train this module using an advanced RL algorithm. On a diverse set of tool-use and reasoning benchmarks, our Refiner improves task completion rates and invocation accuracy over the raw outputs of various upstream LLMs. This highlights our Refiner as a plug-and-play solution for improving the operational reliability of LLM-based agents. We release our code to facilitate future research.
Anthology ID:
2026.findings-acl.731
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
14866–14898
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.731/
DOI:
Bibkey:
Cite (ACL):
Qirui Jiao, Dian Jiao, Nan Du, Ying Shen, and Liang Lin. 2026. Invocation Refiner: A Plug-and-Play Module for Rectifying LLM Tool Invocations. In Findings of the Association for Computational Linguistics: ACL 2026, pages 14866–14898, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Invocation Refiner: A Plug-and-Play Module for Rectifying LLM Tool Invocations (Jiao et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.731.pdf
Checklist:
 2026.findings-acl.731.checklist.pdf