CARE: A Disagreement Detection Framework with Concept Alignment and Reasoning Enhancement
Jiyuan Liu, Jielin Song, Yunhe Pang, Zhiyu Shen, Yanghui Rao
Abstract
Disagreement detection is a crucial task in natural language processing (NLP), particularly in analyzing online discussions and social media content. Large language models (LLMs) have demonstrated significant advancements across various NLP tasks. However, the performance of LLM in disagreement detection is limited by two issues: *conceptual gap* and *reasoning gap*. In this paper, we propose a novel two-stage framework, Concept Alignment and Reasoning Enhancement (CARE), to tackle the issues. The first stage, Concept Alignment, addresses the gap between expert and model by performing **sub-concept taxonomy extraction**, aligning the model’s comprehension with human experts. The second stage, Reasoning Enhancement, improves the model’s reasoning capabilities by introducing curriculum learning workflow, which includes **rationale to critique** and **counterfactual to detection** for reducing spurious association. Extensive experiments on disagreement detection task demonstrate the effectiveness of our framework, showing superior performance in zero-shot and supervised learning settings, both within and across domains.- Anthology ID:
- 2025.emnlp-main.671
- Volume:
- Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
- Month:
- November
- Year:
- 2025
- Address:
- Suzhou, China
- Editors:
- Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 13275–13290
- Language:
- URL:
- https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.671/
- DOI:
- Cite (ACL):
- Jiyuan Liu, Jielin Song, Yunhe Pang, Zhiyu Shen, and Yanghui Rao. 2025. CARE: A Disagreement Detection Framework with Concept Alignment and Reasoning Enhancement. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 13275–13290, Suzhou, China. Association for Computational Linguistics.
- Cite (Informal):
- CARE: A Disagreement Detection Framework with Concept Alignment and Reasoning Enhancement (Liu et al., EMNLP 2025)
- PDF:
- https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.671.pdf