Explaining Decision-Tree Predictions by Addressing Potential Conflicts between Predictions and Plausible Expectations
Sameen Maruf, Ingrid Zukerman, Ehud Reiter, Gholamreza Haffari
Abstract
We offer an approach to explain Decision Tree (DT) predictions by addressing potential conflicts between aspects of these predictions and plausible expectations licensed by background information. We define four types of conflicts, operationalize their identification, and specify explanatory schemas that address them. Our human evaluation focused on the effect of explanations on users’ understanding of a DT’s reasoning and their willingness to act on its predictions. The results show that (1) explanations that address potential conflicts are considered at least as good as baseline explanations that just follow a DT path; and (2) the conflict-based explanations are deemed especially valuable when users’ expectations disagree with the DT’s predictions.- Anthology ID:
- 2021.inlg-1.12
- Volume:
- Proceedings of the 14th International Conference on Natural Language Generation
- Month:
- August
- Year:
- 2021
- Address:
- Aberdeen, Scotland, UK
- Editors:
- Anya Belz, Angela Fan, Ehud Reiter, Yaji Sripada
- Venue:
- INLG
- SIG:
- SIGGEN
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 114–127
- Language:
- URL:
- https://aclanthology.org/2021.inlg-1.12
- DOI:
- 10.18653/v1/2021.inlg-1.12
- Cite (ACL):
- Sameen Maruf, Ingrid Zukerman, Ehud Reiter, and Gholamreza Haffari. 2021. Explaining Decision-Tree Predictions by Addressing Potential Conflicts between Predictions and Plausible Expectations. In Proceedings of the 14th International Conference on Natural Language Generation, pages 114–127, Aberdeen, Scotland, UK. Association for Computational Linguistics.
- Cite (Informal):
- Explaining Decision-Tree Predictions by Addressing Potential Conflicts between Predictions and Plausible Expectations (Maruf et al., INLG 2021)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-2/2021.inlg-1.12.pdf