Beyond Discrete Search: Divergent Thinking as Intention Optimization in Latent Space

Mateusz Bystroński, Grzegorz Piotrowski, Tomasz Jan Kajdanowicz


Abstract
We argue that LLM-based coding agents frequently fail to solve problems that lie within the model’s capacity and the bottleneck is often the conditioning context rather than the model itself. We formalize this for the full class of Turing-computable problems with verifiable specifications and introduce a framework that recasts coding as optimization overconditioning contexts that influence the generation of natural-languagesolution intentions. Guided by execution feedback, the method searches thiscontinuous context space to steer a coding agent toward correct solutions. The method operates as a plug-in layer that can wrap any coding agent without modifying its architecture or weights. On SWE-Bench Verified, our method raises the resolution rate of a weak, quantized 24B open-weight model to parity with frontier models +25× its size.
Anthology ID:
2026.acl-srw.88
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Santosh T.Y.S.S., Juan Diego Rodriguez, Ona de Gibert
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1007–1016
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-srw.88/
DOI:
Bibkey:
Cite (ACL):
Mateusz Bystroński, Grzegorz Piotrowski, and Tomasz Jan Kajdanowicz. 2026. Beyond Discrete Search: Divergent Thinking as Intention Optimization in Latent Space. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026), pages 1007–1016, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Beyond Discrete Search: Divergent Thinking as Intention Optimization in Latent Space (Bystroński et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-srw.88.pdf