Logical DA: Enhancing Data Augmentation for Logical Reasoning via a Multi-Agent System

Haoqi Zheng, Dong Wang, Silin Yang, Yunpeng Qi, Ruochun Jin, Liyang Xu


Abstract
Recent advancements in large language models (LLMs) have highlighted the importance of improving their reasoning capabilities. A critical challenge lies in the scarcity of high-quality reasoning data—characterized by diversity and rich supervisory signals—necessary for robust model training. While data augmentation (DA) methods have been leveraged to mitigate this scarcity, prevailing approaches often introduce noise and exhibit logical inconsistencies, thereby diminishing their utility for complex reasoning tasks. Moreover, existing DA paradigms predominantly isolate data synthesis from label validation, failing to unify these complementary processes within a cohesive architecture.To address these limitations, we introduce Logical DA, a multi-agent framework for enhancing reasoning-focused data augmentation in few-shot learning scenarios. Our system includes four agents operating through two synergistic phases: (1) diverse data generation, and (2) label verification.The system incorporates a reflection mechanism to continuously improve data quality by leveraging feedback from logical validation. We demonstrate the effectiveness of Logical DA through experiments on various tasks and datasets, achieving the highest average improvement in task accuracy in both fine-tuning and in-context learning paradigms, with an average improvement of 7.61% when applied to fine-tuning.
Anthology ID:
2025.findings-acl.356
Volume:
Findings of the Association for Computational Linguistics: ACL 2025
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6843–6855
Language:
URL:
https://preview.aclanthology.org/mtsummit-25-ingestion/2025.findings-acl.356/
DOI:
10.18653/v1/2025.findings-acl.356
Bibkey:
Cite (ACL):
Haoqi Zheng, Dong Wang, Silin Yang, Yunpeng Qi, Ruochun Jin, and Liyang Xu. 2025. Logical DA: Enhancing Data Augmentation for Logical Reasoning via a Multi-Agent System. In Findings of the Association for Computational Linguistics: ACL 2025, pages 6843–6855, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Logical DA: Enhancing Data Augmentation for Logical Reasoning via a Multi-Agent System (Zheng et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/mtsummit-25-ingestion/2025.findings-acl.356.pdf