Soham Parikh
2023
Exploring Zero and Few-shot Techniques for Intent Classification
Soham Parikh
|
Mitul Tiwari
|
Prashil Tumbade
|
Quaizar Vohra
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 5: Industry Track)
Conversational NLU providers often need to scale to thousands of intent-classification models where new customers often face the cold-start problem. Scaling to so many customers puts a constraint on storage space as well. In this paper, we explore four different zero and few-shot intent classification approaches with this low-resource constraint: 1) domain adaptation, 2) data augmentation, 3) zero-shot intent classification using descriptions large language models (LLMs), and 4) parameter-efficient fine-tuning of instruction-finetuned language models. Our results show that all these approaches are effective to different degrees in low-resource settings. Parameter-efficient fine-tuning using T-few recipe on Flan-T5 yields the best performance even with just one sample per intent. We also show that the zero-shot method of prompting LLMs using intent descriptions is also very competitive.
2022
Improving Dialogue Act Recognition with Augmented Data
Khyati Mahajan
|
Soham Parikh
|
Quaizar Vohra
|
Mitul Tiwari
|
Samira Shaikh
Proceedings of the 2nd Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)
We present our work on augmenting dialog act recognition capabilities utilizing synthetically generated data. Our work is motivated by the limitations of current dialog act datasets, and the need to adapt for new domains as well as ambiguity in utterances written by humans. We list our observations and findings towards how synthetically generated data can contribute meaningfully towards more robust dialogue act recognition models extending to new domains. Our major finding shows that synthetic data, which is linguistically varied, can be very useful towards this goal and increase the performance from (0.39, 0.16) to (0.85, 0.88) for AFFIRM and NEGATE dialog acts respectively.
2019
Browsing Health: Information Extraction to Support New Interfaces for Accessing Medical Evidence
Soham Parikh
|
Elizabeth Conrad
|
Oshin Agarwal
|
Iain Marshall
|
Byron Wallace
|
Ani Nenkova
Proceedings of the Workshop on Extracting Structured Knowledge from Scientific Publications
Standard paradigms for search do not work well in the medical context. Typical information needs, such as retrieving a full list of medical interventions for a given condition, or finding the reported efficacy of a particular treatment with respect to a specific outcome of interest cannot be straightforwardly posed in typical text-box search. Instead, we propose faceted-search in which a user specifies a condition and then can browse treatments and outcomes that have been evaluated. Choosing from these, they can access randomized control trials (RCTs) describing individual studies. Realizing such a view of the medical evidence requires information extraction techniques to identify the population, interventions, and outcome measures in an RCT. Patients, health practitioners, and biomedical librarians all stand to benefit from such innovation in search of medical evidence. We present an initial prototype of such an interface applied to pre-registered clinical studies. We also discuss pilot studies into the applicability of information extraction methods to allow for similar access to all published trial results.
Search
Co-authors
- Mitul Tiwari 2
- Quaizar Vohra 2
- Elizabeth Conrad 1
- Oshin Agarwal 1
- Iain Marshall 1
- show all...