Make Your Decision Convincing! A Unified Two-Stage Framework: Self-Attribution and Decision-Making

Yanrui Du, Sendong Zhao, Haochun Wang, Yuhan Chen, Rui Bai, Zewen Qiang, Muzhen Cai, Bing Qin

Abstract
Explaining black-box model behavior with natural language has achieved impressive results in various NLP tasks. Recent research has explored the utilization of subsequences from the input text as a rationale, providing users with evidence to support the model decision. Although existing frameworks excel in generating high-quality rationales while achieving high task performance, they neglect to account for the unreliable link between the generated rationale and model decision. In simpler terms, a model may make correct decisions while attributing wrong rationales, or make poor decisions while attributing correct rationales. To mitigate this issue, we propose a unified two-stage framework known as Self-Attribution and Decision-Making (SADM). Through extensive experiments on five reasoning datasets from the ERASER benchmark, we demonstrate that our framework not only establishes a more reliable link between the generated rationale and model decision but also achieves competitive results in task performance and the quality of rationale. Furthermore, we explore the potential of our framework in semi-supervised scenarios.
Anthology ID:
2023.findings-emnlp.78
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1101–1112
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.78
DOI:
10.18653/v1/2023.findings-emnlp.78
Bibkey:
Cite (ACL):
Yanrui Du, Sendong Zhao, Haochun Wang, Yuhan Chen, Rui Bai, Zewen Qiang, Muzhen Cai, and Bing Qin. 2023. Make Your Decision Convincing! A Unified Two-Stage Framework: Self-Attribution and Decision-Making. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 1101–1112, Singapore. Association for Computational Linguistics.
Cite (Informal):
Make Your Decision Convincing! A Unified Two-Stage Framework: Self-Attribution and Decision-Making (Du et al., Findings 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-2/2023.findings-emnlp.78.pdf
PDF Search