Format-Adapter: Improving Reasoning Capability of LLMs by Adapting Suitable Format

Dingzirui Wang, Xuanliang Zhang, Rongyu Cao, Longxu Dou, Xianzhen Luo, Yingwei MA, Qingfu Zhu, Binhua Li, Fei Huang, Yongbin Li


Abstract
Generating and voting multiple answers is an effective method to mitigate reasoning inconsistencies of large language models (LLMs). Prior works have shown that multiple reasoning formats outperform a single format when generating multiple answers. However, previous works using multiple formats rely on formats labeled by humans, which could be unsuitable for all tasks and have high labeling costs. To address this issue, we adapt suitable formats to the given tasks by generating and selecting formats. We first propose how to measure the reasoning error when generating multiple answers. Then, we introduce Format-Adapter, which utilizes LLMs to generate and select suitable reasoning formats by minimizing the error measurement we present. We conduct experiments on math and commonsense reasoning tasks, where Format-Adapter achieves a 4.3% performance improvement on average over previous works, demonstrating the effectiveness.
Anthology ID:
2026.findings-acl.1124
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
22408–22427
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1124/
DOI:
Bibkey:
Cite (ACL):
Dingzirui Wang, Xuanliang Zhang, Rongyu Cao, Longxu Dou, Xianzhen Luo, Yingwei MA, Qingfu Zhu, Binhua Li, Fei Huang, and Yongbin Li. 2026. Format-Adapter: Improving Reasoning Capability of LLMs by Adapting Suitable Format. In Findings of the Association for Computational Linguistics: ACL 2026, pages 22408–22427, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Format-Adapter: Improving Reasoning Capability of LLMs by Adapting Suitable Format (Wang et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1124.pdf
Checklist:
 2026.findings-acl.1124.checklist.pdf