Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling
Kalpa Gunaratna, Vijay Srinivasan, Akhila Yerukola, Hongxia Jin
Abstract
Joint intent detection and slot filling is a key research topic in natural language understanding (NLU). Existing joint intent and slot filling systems analyze and compute features collectively for all slot types, and importantly, have no way to explain the slot filling model decisions. In this work, we propose a novel approach that: (i) learns to generate additional slot type specific features in order to improve accuracy and (ii) provides explanations for slot filling decisions for the first time in a joint NLU model. We perform an additional constrained supervision using a set of binary classifiers for the slot type specific feature learning, thus ensuring appropriate attention weights are learned in the process to explain slot filling decisions for utterances. Our model is inherently explainable and does not need any post-hoc processing. We evaluate our approach on two widely used datasets and show accuracy improvements. Moreover, a detailed analysis is also provided for the exclusive slot explainability.- Anthology ID:
- 2022.findings-emnlp.245
- Volume:
- Findings of the Association for Computational Linguistics: EMNLP 2022
- Month:
- December
- Year:
- 2022
- Address:
- Abu Dhabi, United Arab Emirates
- Editors:
- Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 3367–3378
- Language:
- URL:
- https://aclanthology.org/2022.findings-emnlp.245
- DOI:
- 10.18653/v1/2022.findings-emnlp.245
- Cite (ACL):
- Kalpa Gunaratna, Vijay Srinivasan, Akhila Yerukola, and Hongxia Jin. 2022. Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 3367–3378, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
- Cite (Informal):
- Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling (Gunaratna et al., Findings 2022)
- PDF:
- https://preview.aclanthology.org/naacl24-info/2022.findings-emnlp.245.pdf