Experience-Driven Reflective Co-Evolution of Prompts and Heuristics for Autonomous Algorithm Design

Yihong Liu, Junyi Li, Hongyu Lu, Xin Zhao, Ji-Rong Wen


Abstract
Combinatorial optimization has long been dominated by manually engineered heuristics, a paradigm requiring substantial expert intuition and implementation overhead. The advent of Large Language Models has disrupted this landscape, enabling the autonomous synthesis and optimization of algorithms. Recent approaches typically iterate on heuristic populations using LLMs as mutators; however, these strategies often suffer from limited exploration, leading to stagnation in local optima. To overcome this, we present the Experience-Driven Reflective Co-Evolution of Prompt and Heuristics (EvoPH) for autonomous algorithm design, a novel framework that couples an island migration model with elite selection to maintain population diversity. Uniquely, EvoPH co-evolves both the guiding prompts and the heuristics themselves, using a feedback loop driven by past experience to refine the search process. We demonstrate EvoPH’s efficacy on the Traveling Salesman and Bin Packing Problems. Our results show that EvoPH achieves superior accuracy compared to baselines, marking a significant step forward in LLM-aided algorithm design.
Anthology ID:
2026.findings-acl.245
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4981–4995
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.245/
DOI:
Bibkey:
Cite (ACL):
Yihong Liu, Junyi Li, Hongyu Lu, Xin Zhao, and Ji-Rong Wen. 2026. Experience-Driven Reflective Co-Evolution of Prompts and Heuristics for Autonomous Algorithm Design. In Findings of the Association for Computational Linguistics: ACL 2026, pages 4981–4995, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Experience-Driven Reflective Co-Evolution of Prompts and Heuristics for Autonomous Algorithm Design (Liu et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.245.pdf
Checklist:
 2026.findings-acl.245.checklist.pdf