Decisive: Guiding User Decisions with Optimal Preference Elicitation from Unstructured Documents
Akriti Jain, Anish Mulay, Divyansh Verma, Aishani Pandey, Pritika Ramu, Aparna Garimella
Abstract
Decision-making is a cognitively intensive task that requires synthesizing relevant information from multiple unstructured sources, weighing competing factors, and incorporating subjective user preferences. Existing methods, including large language models and traditional decision-support systems, fall short: they often overwhelm users with information or fail to capture nuanced preferences accurately. We present Decisive, an interactive decision-making framework that combines document-grounded reasoning with Bayesian preference inference. Our approach grounds decisions in an objective option-scoring matrix extracted from source documents, while actively learning a user’s latent preference vector through targeted elicitation. Users answer pairwise tradeoff questions adaptively selected to maximize information gain over the final decision. This process converges efficiently, minimizing user effort while ensuring recommendations remain transparent and personalized. Through extensive experiments, we demonstrate that our approach significantly outperforms both general-purpose LLMs and existing decision-making frameworks achieving up to 20% improvement in decision accuracy over strong baselines across domains.- Anthology ID:
- 2026.acl-long.1465
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 31774–31786
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.1465/
- DOI:
- Cite (ACL):
- Akriti Jain, Anish Mulay, Divyansh Verma, Aishani Pandey, Pritika Ramu, and Aparna Garimella. 2026. Decisive: Guiding User Decisions with Optimal Preference Elicitation from Unstructured Documents. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 31774–31786, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- Decisive: Guiding User Decisions with Optimal Preference Elicitation from Unstructured Documents (Jain et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.1465.pdf