Automatic Generation of Structured Domain Knowledge for Dialogue-based XAI Systems
Carolin Schindler, Isabel Feustel, Niklas Rach, Wolfgang Minker
Abstract
Explanatory dialogue systems serve as intuitive interface between non-expert users and explainable AI (XAI) systems. The interaction with these kind of systems benefits especially from the integration of structured domain knowledge, e.g., by means of bipolar argumentation trees. So far, these domain-specific structures need to be created manually, therewith impairing the flexibility of the system with respect to the domain. We address this limitation by adapting an existing pipeline for topic-independent acquisition of argumentation trees in the field of persuasive, argumentative dialogue to the area of explanatory dialogue. This shift is achieved by a) introducing and investigating different formulations of auxiliary claims per feature of the explanation of the AI model, b) exploring the influence of pre-grouping of the arguments with respect to the feature they address, c) suggesting adaptions to the existing algorithm of the pipeline for obtaining a tree structure, and d) utilizing a new approach for determining the type of the relationship between the arguments. Through a step-wise expert evaluation for the domain titanic survival, we identify the best performing variant of our pipeline. With this variant we conduct a user study comparing the automatically generated argumentation trees against their manually created counterpart in the domains titanic survival and credit acquisition. This assessment of the suitability of the generated argumentation trees for a later integration into dialogue-based XAI systems as domain knowledge yields promising results.- Anthology ID:
- 2025.iwsds-1.1
- Volume:
- Proceedings of the 15th International Workshop on Spoken Dialogue Systems Technology
- Month:
- May
- Year:
- 2025
- Address:
- Bilbao, Spain
- Editors:
- Maria Ines Torres, Yuki Matsuda, Zoraida Callejas, Arantza del Pozo, Luis Fernando D'Haro
- Venues:
- IWSDS | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1–11
- Language:
- URL:
- https://preview.aclanthology.org/fix-sig-urls/2025.iwsds-1.1/
- DOI:
- Cite (ACL):
- Carolin Schindler, Isabel Feustel, Niklas Rach, and Wolfgang Minker. 2025. Automatic Generation of Structured Domain Knowledge for Dialogue-based XAI Systems. In Proceedings of the 15th International Workshop on Spoken Dialogue Systems Technology, pages 1–11, Bilbao, Spain. Association for Computational Linguistics.
- Cite (Informal):
- Automatic Generation of Structured Domain Knowledge for Dialogue-based XAI Systems (Schindler et al., IWSDS 2025)
- PDF:
- https://preview.aclanthology.org/fix-sig-urls/2025.iwsds-1.1.pdf