CARE: A Disagreement Detection Framework with Concept Alignment and Reasoning Enhancement

Jiyuan Liu, Jielin Song, Yunhe Pang, Zhiyu Shen, Yanghui Rao


Abstract
Disagreement detection is a crucial task in natural language processing (NLP), particularly in analyzing online discussions and social media content. Large language models (LLMs) have demonstrated significant advancements across various NLP tasks. However, the performance of LLM in disagreement detection is limited by two issues: *conceptual gap* and *reasoning gap*. In this paper, we propose a novel two-stage framework, Concept Alignment and Reasoning Enhancement (CARE), to tackle the issues. The first stage, Concept Alignment, addresses the gap between expert and model by performing **sub-concept taxonomy extraction**, aligning the model’s comprehension with human experts. The second stage, Reasoning Enhancement, improves the model’s reasoning capabilities by introducing curriculum learning workflow, which includes **rationale to critique** and **counterfactual to detection** for reducing spurious association. Extensive experiments on disagreement detection task demonstrate the effectiveness of our framework, showing superior performance in zero-shot and supervised learning settings, both within and across domains.
Anthology ID:
2025.emnlp-main.671
Volume:
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13275–13290
Language:
URL:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.671/
DOI:
Bibkey:
Cite (ACL):
Jiyuan Liu, Jielin Song, Yunhe Pang, Zhiyu Shen, and Yanghui Rao. 2025. CARE: A Disagreement Detection Framework with Concept Alignment and Reasoning Enhancement. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 13275–13290, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
CARE: A Disagreement Detection Framework with Concept Alignment and Reasoning Enhancement (Liu et al., EMNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.671.pdf
Checklist:
 2025.emnlp-main.671.checklist.pdf