ICLER: Intent CLassification with Enhanced Reasoning

Dezheng Gao, Dong Xiaozheng, SHuangtao Yang, Bo Fu


Abstract
In recent years, intent classification technology based on In-Context Learning (ICL) has made significant progress. However, when applied to enterprise vertical domains, existing methods are inadequate in identifying micro-grained intentions. This study identifies two primary causes of errors in data analysis: (1) Retrieving incorrect instances, this is often due to the limitations of embedding models in capturing subtle sentence-level information in business scenarios (such as entity-related or phenomenon-specific details) (2) Insufficient reasoning ability of Large Language Models (LLMs), which tend to rely on surface-level semantics while overlooking deeper semantic associations and business logic, leading to misclassification. To address these issues, we propose ICLER, an intent classification method with enhanced reasoning. This method first optimizes the embedding model by introducing a reasoning mechanism to enhance its ability to fine-grained sentence-level information. Then, this mechanism is incorporated into the ICL framework, maintaining computational efficiency while significantly enhancing intent recognition accuracy. Experimental results demonstrate that ICLER significantly outperforms the original ICL method in intent identification within vertical domains. Moreover, it yields accuracy improvements of 0.04% to 1.14% on general datasets and its fine-tuned embedding model achieves an average performance gain of 5.56% on selected classification tasks in the MTEB benchmark.
Anthology ID:
2025.findings-emnlp.164
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3031–3044
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.164/
DOI:
10.18653/v1/2025.findings-emnlp.164
Bibkey:
Cite (ACL):
Dezheng Gao, Dong Xiaozheng, SHuangtao Yang, and Bo Fu. 2025. ICLER: Intent CLassification with Enhanced Reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 3031–3044, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
ICLER: Intent CLassification with Enhanced Reasoning (Gao et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.164.pdf
Checklist:
 2025.findings-emnlp.164.checklist.pdf