Decisive: Guiding User Decisions with Optimal Preference Elicitation from Unstructured Documents

Akriti Jain, Anish Mulay, Divyansh Verma, Aishani Pandey, Pritika Ramu, Aparna Garimella


Abstract
Decision-making is a cognitively intensive task that requires synthesizing relevant information from multiple unstructured sources, weighing competing factors, and incorporating subjective user preferences. Existing methods, including large language models and traditional decision-support systems, fall short: they often overwhelm users with information or fail to capture nuanced preferences accurately. We present Decisive, an interactive decision-making framework that combines document-grounded reasoning with Bayesian preference inference. Our approach grounds decisions in an objective option-scoring matrix extracted from source documents, while actively learning a user’s latent preference vector through targeted elicitation. Users answer pairwise tradeoff questions adaptively selected to maximize information gain over the final decision. This process converges efficiently, minimizing user effort while ensuring recommendations remain transparent and personalized. Through extensive experiments, we demonstrate that our approach significantly outperforms both general-purpose LLMs and existing decision-making frameworks achieving up to 20% improvement in decision accuracy over strong baselines across domains.
Anthology ID:
2026.acl-long.1465
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
31774–31786
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1465/
DOI:
Bibkey:
Cite (ACL):
Akriti Jain, Anish Mulay, Divyansh Verma, Aishani Pandey, Pritika Ramu, and Aparna Garimella. 2026. Decisive: Guiding User Decisions with Optimal Preference Elicitation from Unstructured Documents. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 31774–31786, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Decisive: Guiding User Decisions with Optimal Preference Elicitation from Unstructured Documents (Jain et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1465.pdf
Checklist:
 2026.acl-long.1465.checklist.pdf