A Dialogue System for Semi-Structured Interviews by LLMs and its Evaluation on Persona Information Collection

Ryo Hasegawa, Yijie Hua, Takehito Utsuro, Ekai Hashimoto, Mikio Nakano, Shun Shiramatsu


Abstract
In this paper, we propose a dialogue control management framework using large language models for semi-structured interviews. Specifically, large language models are used to generate the interviewer’s utterances and to make conditional branching decisions based on the understanding of the interviewee’s responses. The framework enables flexible dialogue control in interview conversations by generating and updating slots and values according to interviewee answers. More importantly, we invented through LLMs’ prompt tuning the framework of accumulating the list of slots generated along the course of incrementing the number of interviewees through the semi-structured interviews. Evaluation results showed that the proposed approach of accumulating the list of generated slots throughout the semi-structured interviews outperform the baseline without accumulating generated slots in terms of the number of persona attributes and values collected through the semi-structured interview.
Anthology ID:
2025.iwsds-1.5
Volume:
Proceedings of the 15th International Workshop on Spoken Dialogue Systems Technology
Month:
May
Year:
2025
Address:
Bilbao, Spain
Editors:
Maria Ines Torres, Yuki Matsuda, Zoraida Callejas, Arantza del Pozo, Luis Fernando D'Haro
Venues:
IWSDS | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
39–59
Language:
URL:
https://preview.aclanthology.org/landing_page/2025.iwsds-1.5/
DOI:
Bibkey:
Cite (ACL):
Ryo Hasegawa, Yijie Hua, Takehito Utsuro, Ekai Hashimoto, Mikio Nakano, and Shun Shiramatsu. 2025. A Dialogue System for Semi-Structured Interviews by LLMs and its Evaluation on Persona Information Collection. In Proceedings of the 15th International Workshop on Spoken Dialogue Systems Technology, pages 39–59, Bilbao, Spain. Association for Computational Linguistics.
Cite (Informal):
A Dialogue System for Semi-Structured Interviews by LLMs and its Evaluation on Persona Information Collection (Hasegawa et al., IWSDS 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/landing_page/2025.iwsds-1.5.pdf