Escaping the Sisyphus Dilemma: Experience Replay for Robust Text-to-Optimization Modeling

Wantong Xie, Yinghao Chen, Yi-Xiang Hu, Feng Wu, Jieyang Xu, Sijia Zhang, Xiangyang Li


Abstract
Large Language Models have shown promise in translating natural language into executable optimization models, yet they often suffer from the Sisyphus Dilemma: a memoryless cycle where identical errors are repeated across structurally similar problems. Existing retrieval-augmented strategies primarily fetch static problem-model pairs as few-shot demonstrators, failing to capture the dynamic reasoning required to resolve execution failures. To bridge this gap, we propose EOM, a framework that implements Experience Replay to transform transient rectification steps into persistent knowledge. EOM distills interaction histories into Causal Correction Mappings, indexing both diagnostic insights and prohibitive traps. By utilizing a structure-aware retrieval mechanism that aligns semantic intent with abstract syntax trees and solver tracebacks, the system enables models to recall specific correction strategies for isomorphic errors. Extensive experiments across seven benchmarks demonstrate that EOM improves modeling accuracy by 8.45% on complex tasks while reducing token consumption by 28.65% and interaction turns by 25.82%, validating the efficiency of a “Rectify Once, Solve Many” paradigm.
Anthology ID:
2026.findings-acl.690
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
14100–14116
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.690/
DOI:
Bibkey:
Cite (ACL):
Wantong Xie, Yinghao Chen, Yi-Xiang Hu, Feng Wu, Jieyang Xu, Sijia Zhang, and Xiangyang Li. 2026. Escaping the Sisyphus Dilemma: Experience Replay for Robust Text-to-Optimization Modeling. In Findings of the Association for Computational Linguistics: ACL 2026, pages 14100–14116, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Escaping the Sisyphus Dilemma: Experience Replay for Robust Text-to-Optimization Modeling (Xie et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.690.pdf
Checklist:
 2026.findings-acl.690.checklist.pdf