@inproceedings{wevelsiep-etal-2025-voice,
    title = "A Voice-Controlled Dialogue System for {NPC} Interaction using Large Language Models",
    author = "Wevelsiep, Milan  and
      Walker, Nicholas Thomas  and
      Wagner, Nicolas  and
      Ultes, Stefan",
    editor = "Torres, Maria Ines  and
      Matsuda, Yuki  and
      Callejas, Zoraida  and
      del Pozo, Arantza  and
      D'Haro, Luis Fernando",
    booktitle = "Proceedings of the 15th International Workshop on Spoken Dialogue Systems Technology",
    month = may,
    year = "2025",
    address = "Bilbao, Spain",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/landing_page/2025.iwsds-1.4/",
    pages = "29--38",
    ISBN = "979-8-89176-248-0",
    abstract = "This paper explores the integration of voice-controlled dialogue systems in narrative-driven video games, addressing the limitations of existing approaches. We propose a hybrid interface that allows players to freely paraphrase predefined dialogue options, combining player expressiveness with narrative cohesion. The prototype was developed in Unity, and a large language model was used to map the transcribed voice input to existing dialogue options. The approach was evaluated in a user study (n=14) that compared the hybrid interface to traditional point-and-click methods. Results indicate the proposed interface enhances player{'}s degree of joy and perceived freedom while maintaining narrative consistency. The findings provide insights into the design of scalable and engaging voice-controlled systems for interactive storytelling. Future research should focus on reducing latency and refining language model accuracy to further improve user experience and immersion."
}