C3D: Enhancing LLM Reasoning via Confidence-Guided Contrastive Decoding

Yufeng Zhang, Xuepeng Wang, Lingxiang Wu, Jinqiao Wang


Abstract
Large language models (LLMs) are prone to distraction by contextual information during reasoning. Previous work primarily focuses on improving the generation of the next token while overlooking the potential bias introduced by existing premises. We propose a novel decoding method to mitigate such biases. Our framework uses predicted logits to estimate the model’s confidence. By decomposing the full context into multiple premises, we gain a clearer understanding of the relevance of each premise to the question. During next-token prediction, we refine the output by contrasting the logits with the highest and lowest confidence. Our method effectively reveals how the model dynamically activates and adjusts its consideration of each premise as reasoning progresses.
Anthology ID:
2026.findings-acl.33
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
700–712
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.33/
DOI:
Bibkey:
Cite (ACL):
Yufeng Zhang, Xuepeng Wang, Lingxiang Wu, and Jinqiao Wang. 2026. C3D: Enhancing LLM Reasoning via Confidence-Guided Contrastive Decoding. In Findings of the Association for Computational Linguistics: ACL 2026, pages 700–712, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
C3D: Enhancing LLM Reasoning via Confidence-Guided Contrastive Decoding (Zhang et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.33.pdf
Checklist:
 2026.findings-acl.33.checklist.pdf