Beyond Discrete Search: Divergent Thinking as Intention Optimization in Latent Space
Mateusz Bystroński, Grzegorz Piotrowski, Tomasz Jan Kajdanowicz
Abstract
We argue that LLM-based coding agents frequently fail to solve problems that lie within the model’s capacity and the bottleneck is often the conditioning context rather than the model itself. We formalize this for the full class of Turing-computable problems with verifiable specifications and introduce a framework that recasts coding as optimization overconditioning contexts that influence the generation of natural-languagesolution intentions. Guided by execution feedback, the method searches thiscontinuous context space to steer a coding agent toward correct solutions. The method operates as a plug-in layer that can wrap any coding agent without modifying its architecture or weights. On SWE-Bench Verified, our method raises the resolution rate of a weak, quantized 24B open-weight model to parity with frontier models +25× its size.- Anthology ID:
- 2026.acl-srw.88
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Santosh T.Y.S.S., Juan Diego Rodriguez, Ona de Gibert
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1007–1016
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-srw.88/
- DOI:
- Cite (ACL):
- Mateusz Bystroński, Grzegorz Piotrowski, and Tomasz Jan Kajdanowicz. 2026. Beyond Discrete Search: Divergent Thinking as Intention Optimization in Latent Space. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026), pages 1007–1016, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- Beyond Discrete Search: Divergent Thinking as Intention Optimization in Latent Space (Bystroński et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-srw.88.pdf