Spec-TOD: A Specialized Instruction-Tuned LLM Framework for Efficient Task-Oriented Dialogue Systems
Vinh Quang Nguyen, Nguyen Quang Chieu, Hoang Viet Pham, Khac-Hoai Nam Bui
Abstract
Task-oriented dialogue (TOD) systems facilitate goal-driven interactions between users and machines. While recent advances in deep learning have improved the performance, TOD systems often struggle in low-resource scenarios with limited labeled data. To address this challenge, we propose Spec-TOD, a novel framework designed to train an end-to-end TOD system with limited data. Spec-TOD introduces two main innovations: (i) a novel specialized end-to-end TOD framework that incorporates explicit task instructions for instruction-tuned large language models (LLMs), and (ii) an efficient training strategy that leverages lightweight, specialized LLMs to achieve strong performance with minimal supervision. Experiments on the MultiWOZ dataset, a widely used TOD benchmark, demonstrate that Spec-TOD achieves competitive results while significantly reducing the need for labeled data. These findings highlight the potential of the proposed framework in advancing efficient and effective TOD systems in low-resource settings.- Anthology ID:
- 2025.sigdial-1.8
- Volume:
- Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue
- Month:
- August
- Year:
- 2025
- Address:
- Avignon, France
- Editors:
- Frédéric Béchet, Fabrice Lefèvre, Nicholas Asher, Seokhwan Kim, Teva Merlin
- Venue:
- SIGDIAL
- SIG:
- SIGDIAL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 133–145
- Language:
- URL:
- https://preview.aclanthology.org/add-orcids-2024-emnlp/2025.sigdial-1.8/
- DOI:
- Cite (ACL):
- Vinh Quang Nguyen, Nguyen Quang Chieu, Hoang Viet Pham, and Khac-Hoai Nam Bui. 2025. Spec-TOD: A Specialized Instruction-Tuned LLM Framework for Efficient Task-Oriented Dialogue Systems. In Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 133–145, Avignon, France. Association for Computational Linguistics.
- Cite (Informal):
- Spec-TOD: A Specialized Instruction-Tuned LLM Framework for Efficient Task-Oriented Dialogue Systems (Nguyen et al., SIGDIAL 2025)
- PDF:
- https://preview.aclanthology.org/add-orcids-2024-emnlp/2025.sigdial-1.8.pdf