Interpretable Satisfaction Modeling in Sales Dialogues: A Metrics-based Approach Validated Against Text-based Model
Natalia Krawczyk, Alicja Kasicka, Bartosz Przybył, Justyna Gromada
Abstract
Understanding drivers of customer satisfaction in sales conversations is crucial for dialogue system optimization and customer experience improvement, yet existing neural approaches lack interpretability. We introduce a sales action annotation framework that tracks offers, cross-sells, and customer decisions in sales dialogues. From these structured annotations, we derive interpretable metrics spanning conversion rates, timing and negotiation patterns, and sales outcomes to predict user satisfaction. We validate our metrics-based regression model against a transformer-based text-embedding baseline on 5200 simulated phone sales dialogues. Our interpretable model achieves strong performance (R2=0.87 vs. 0.92 for the baseline) with full transparency, identifying key satisfaction drivers with practical implications for dialogue design: purchase completion, conversation efficiency, and negotiation patterns.- Anthology ID:
- 2026.sigdial-1.40
- Volume:
- Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue
- Month:
- August
- Year:
- 2026
- Address:
- Atlanta, Georgia, USA
- Editors:
- Jinho D. Choi, Yun-Nung Chen, Kotaro Funakoshi, Ali Emami
- Venue:
- SIGDIAL
- SIG:
- SIGDIAL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 565–584
- Language:
- URL:
- https://preview.aclanthology.org/paragraph-normalization/2026.sigdial-1.40/
- DOI:
- Cite (ACL):
- Natalia Krawczyk, Alicja Kasicka, Bartosz Przybył, and Justyna Gromada. 2026. Interpretable Satisfaction Modeling in Sales Dialogues: A Metrics-based Approach Validated Against Text-based Model. In Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 565–584, Atlanta, Georgia, USA. Association for Computational Linguistics.
- Cite (Informal):
- Interpretable Satisfaction Modeling in Sales Dialogues: A Metrics-based Approach Validated Against Text-based Model (Krawczyk et al., SIGDIAL 2026)
- PDF:
- https://preview.aclanthology.org/paragraph-normalization/2026.sigdial-1.40.pdf