CAC-CoT: Connector-Aware Compact Chain-of-Thought for Efficient Reasoning Data Synthesis Across Dual-System Cognitive Tasks

Sunguk Choi, Yonghoon Kwon, Heondeuk Lee


Abstract
Long chain-of-thought (CoT) prompting helps Large Language Models (LLMs) solve difficult problems, but very long traces often slow or even degrade performance on fast, intuitive “System-1” tasks. We introduce Connector-Aware Compact CoT (CAC-CoT) — a method that deliberately restricts reasoning to a small, fixed set of connector phrases, steering the model toward concise and well — structured explanations. Despite its simplicity, our synthetic method with general-purpose LLMs yields a high-quality training quality. CAC-CoT achieves 85% on GSM8K and 40% on GPQA (System-2) while also achieving 85% on S1-Bench (System-1), surpassing the baseline by over 20%. Its reasoning traces average 300 tokens(ART), about one-third the length of baseline traces, delivering higher efficiency without loss of accuracy.
Anthology ID:
2025.findings-emnlp.1062
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
19515–19530
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.1062/
DOI:
10.18653/v1/2025.findings-emnlp.1062
Bibkey:
Cite (ACL):
Sunguk Choi, Yonghoon Kwon, and Heondeuk Lee. 2025. CAC-CoT: Connector-Aware Compact Chain-of-Thought for Efficient Reasoning Data Synthesis Across Dual-System Cognitive Tasks. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 19515–19530, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
CAC-CoT: Connector-Aware Compact Chain-of-Thought for Efficient Reasoning Data Synthesis Across Dual-System Cognitive Tasks (Choi et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.1062.pdf
Checklist:
 2025.findings-emnlp.1062.checklist.pdf