The Speech-LLM Takes It All: A Truly Fully End-to-End Spoken Dialog State Tracking Approach

Nizar El Ghazal, Antoine Caubrière, Valentin Vielzeuf


Abstract
This paper presents a comparative study of context management strategies for end-to-end Spoken Dialog State Tracking using Speech-LLMs. We systematically evaluate traditional multimodal context (combining text history and spoken current turn), full spoken history, and compressed spoken history approaches. Our experiments on the SpokenWOZ corpus demonstrate that providing the full spoken conversation as input yields the highest performance among models of similar size, significantly surpassing prior methods. Furthermore, we show that attention-pooling-based compression of the spoken history offers a strong trade-off, maintaining competitive accuracy with reduced context size. Detailed analysis confirms that improvements stem from more effective context utilization.
Anthology ID:
2026.lrec-main.206
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
2629–2637
Language:
URL:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.206/
DOI:
Bibkey:
Cite (ACL):
Nizar El Ghazal, Antoine Caubrière, and Valentin Vielzeuf. 2026. The Speech-LLM Takes It All: A Truly Fully End-to-End Spoken Dialog State Tracking Approach. International Conference on Language Resources and Evaluation, main:2629–2637.
Cite (Informal):
The Speech-LLM Takes It All: A Truly Fully End-to-End Spoken Dialog State Tracking Approach (El Ghazal et al., LREC 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.206.pdf