On Collaborating Small and Large Models For Few-shot Intent Detection

Peng Chen, Bang Wang


Abstract
Few-shot intent detection (FSID) targets the classification of user queries into in-scope intent categories or detecting them as out-of-scope, with only a few or even zero labeled examples per class. Existing PLM-based methods struggle in low-resource situations; while LLM-based methods face high inference cost and label interference. To harness their complementary strengths, we propose the FCSLM, a framework that collaborates a small prediction model with a large language model for the FSID task. During training, we leverage LLMs for data augmentation in self-supervised pretraining and supervised fine-tuning a task-specific prediction model. During inference, a multi-round reasoning process first applies the small prediction model to output candidate intents with uncertainty estimations, then invokes an LLM with enriched intent descriptions for refined prediction and OOS detection. Extensive experiments on three benchmark datasets demonstrate that our FCSLM outperforms strong competitors, achieving the new state-of-the-art performance in both intent classification and OOS detection. Our code is available at: https://github.com/hustchenpeng/FCSLM
Anthology ID:
2025.findings-emnlp.749
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13937–13953
Language:
URL:
https://preview.aclanthology.org/name-variant-enfa-fane/2025.findings-emnlp.749/
DOI:
10.18653/v1/2025.findings-emnlp.749
Bibkey:
Cite (ACL):
Peng Chen and Bang Wang. 2025. On Collaborating Small and Large Models For Few-shot Intent Detection. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 13937–13953, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
On Collaborating Small and Large Models For Few-shot Intent Detection (Chen & Wang, Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/name-variant-enfa-fane/2025.findings-emnlp.749.pdf
Checklist:
 2025.findings-emnlp.749.checklist.pdf