Debiasing Large Language Models via Adaptive Causal Prompting with Sketch-of-Thought

Bowen Li, Ziqi Xu, Jing Ren, Renqiang Luo, Xikun Zhang, Xiuzhen Zhang, Yongli Ren, Feng Xia


Abstract
Despite notable advancements in prompting methods for Large Language Models (LLMs), such as Chain-of-Thought (CoT), existing strategies still suffer from excessive token usage and limited generalisability across diverse reasoning tasks. To address these limitations, we propose an Adaptive Causal Prompting with Sketch-of-Thought (ACPS) framework, which leverages structural causal models to infer the causal effect of a query on its answer and adaptively select an appropriate intervention (i.e., standard front-door and conditional front-door adjustments). This design enables generalisable causal reasoning across heterogeneous tasks without task-specific retraining. By replacing verbose CoT with concise Sketch-of-Thought, ACPS enables efficient reasoning that significantly reduces token usage and inference cost. Extensive experiments on multiple reasoning benchmarks and LLMs demonstrate that ACPS consistently outperforms existing prompting baselines in terms of accuracy, robustness, and computational efficiency.
Anthology ID:
2026.findings-eacl.234
Volume:
Findings of the Association for Computational Linguistics: EACL 2026
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4481–4499
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.findings-eacl.234/
DOI:
Bibkey:
Cite (ACL):
Bowen Li, Ziqi Xu, Jing Ren, Renqiang Luo, Xikun Zhang, Xiuzhen Zhang, Yongli Ren, and Feng Xia. 2026. Debiasing Large Language Models via Adaptive Causal Prompting with Sketch-of-Thought. In Findings of the Association for Computational Linguistics: EACL 2026, pages 4481–4499, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
Debiasing Large Language Models via Adaptive Causal Prompting with Sketch-of-Thought (Li et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.findings-eacl.234.pdf
Checklist:
 2026.findings-eacl.234.checklist.pdf