Adaptive Prompt Optimization for Open-Ended Tasks: Uncertainty Preference as a Secondary Signal
Shuyang Zhang, Zhixuan Liu, Zhichen Dong, Hao Zhang, Chaochao Lu, Chao Yang
Abstract
Prompt optimizers are widely used to create high-quality prompts for Large Language Models (LLMs), but their effectiveness remains unstable in practice. This instability is caused by the misalignment between conservative needs (e.g., safety compliance) and open-ended goals (e.g., creative writing). To address this, we propose a semantic-entropy-based method, using task uncertainty to guide prompt optimization. Specifically, we measure the task’s uncertainty level with pre-defined templates, then use this measure to direct prompt optimization: selecting high-entropy prompt candidates for creative tasks and low-entropy candidates for conservative ones. Extensive experiments across various model families demonstrate that our method consistently outperforms baselines by effectively adjusting entropy levels. Our approach requires no training, works with black-box models, and integrates easily into existing prompt optimizers.- Anthology ID:
- 2026.findings-acl.1692
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 33883–33891
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1692/
- DOI:
- Cite (ACL):
- Shuyang Zhang, Zhixuan Liu, Zhichen Dong, Hao Zhang, Chaochao Lu, and Chao Yang. 2026. Adaptive Prompt Optimization for Open-Ended Tasks: Uncertainty Preference as a Secondary Signal. In Findings of the Association for Computational Linguistics: ACL 2026, pages 33883–33891, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- Adaptive Prompt Optimization for Open-Ended Tasks: Uncertainty Preference as a Secondary Signal (Zhang et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1692.pdf