A Closer Look at Few-Shot Out-of-Distribution Intent Detection
Li-Ming Zhan, Haowen Liang, Lu Fan, Xiao-Ming Wu, Albert Y.S. Lam
Abstract
We consider few-shot out-of-distribution (OOD) intent detection, a practical and important problem for the development of task-oriented dialogue systems. Despite its importance, this problem is seldom studied in the literature, let alone examined in a systematic way. In this work, we take a closer look at this problem and identify key issues for research. In our pilot study, we reveal the reason why existing OOD intent detection methods are not adequate in dealing with this problem. Based on the observation, we propose a promising approach to tackle this problem based on latent representation generation and self-supervision. Comprehensive experiments on three real-world intent detection benchmark datasets demonstrate the high effectiveness of our proposed approach and its great potential in improving state-of-the-art methods for few-shot OOD intent detection.- Anthology ID:
- 2022.coling-1.36
- Volume:
- Proceedings of the 29th International Conference on Computational Linguistics
- Month:
- October
- Year:
- 2022
- Address:
- Gyeongju, Republic of Korea
- Editors:
- Nicoletta Calzolari, Chu-Ren Huang, Hansaem Kim, James Pustejovsky, Leo Wanner, Key-Sun Choi, Pum-Mo Ryu, Hsin-Hsi Chen, Lucia Donatelli, Heng Ji, Sadao Kurohashi, Patrizia Paggio, Nianwen Xue, Seokhwan Kim, Younggyun Hahm, Zhong He, Tony Kyungil Lee, Enrico Santus, Francis Bond, Seung-Hoon Na
- Venue:
- COLING
- SIG:
- Publisher:
- International Committee on Computational Linguistics
- Note:
- Pages:
- 451–460
- Language:
- URL:
- https://aclanthology.org/2022.coling-1.36
- DOI:
- Cite (ACL):
- Li-Ming Zhan, Haowen Liang, Lu Fan, Xiao-Ming Wu, and Albert Y.S. Lam. 2022. A Closer Look at Few-Shot Out-of-Distribution Intent Detection. In Proceedings of the 29th International Conference on Computational Linguistics, pages 451–460, Gyeongju, Republic of Korea. International Committee on Computational Linguistics.
- Cite (Informal):
- A Closer Look at Few-Shot Out-of-Distribution Intent Detection (Zhan et al., COLING 2022)
- PDF:
- https://preview.aclanthology.org/landing_page/2022.coling-1.36.pdf
- Code
- liam0949/few-shot-intent-ood