Solver-Independent Automated Problem Formulation via LLMs for High-Cost Simulation-Driven Design

Yuchen Li, Handing Wang, Bing Xue, Mengjie Zhang, Yaochu Jin


Abstract
In the high-cost simulation-driven design domain, translating ambiguous design requirements into a mathematical optimization formulation is a bottleneck for optimizing product performance. This process is time-consuming and heavily reliant on expert knowledge. While large language models (LLMs) offer potential for automating this task, existing approaches either suffer from poor formalization that fails to accurately align with the design intent or rely on solver feedback for data filtering, which is unavailable due to the high simulation costs. To address this challenge, we propose automated problem formulation (APF), a solver-independent framework that utilizes LLMs to convert engineers’ natural language requirements into executable optimization models. The core of this framework is an innovative pipeline for automatically generating high-quality data, which overcomes the difficulty of constructing suitable fine-tuning datasets in the absence of high-cost solver feedback with the help of data generation and test instance annotation. The generated high-quality dataset is used to perform supervised fine-tuning on LLMs, significantly enhancing their ability to generate accurate and executable optimization problem formulations. Experimental results on antenna design demonstrate that APF significantly outperforms the existing methods in both the accuracy of requirement formalization and the quality of resulting radiation efficiency curves in meeting the design goals.
Anthology ID:
2026.findings-acl.102
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2138–2153
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.102/
DOI:
Bibkey:
Cite (ACL):
Yuchen Li, Handing Wang, Bing Xue, Mengjie Zhang, and Yaochu Jin. 2026. Solver-Independent Automated Problem Formulation via LLMs for High-Cost Simulation-Driven Design. In Findings of the Association for Computational Linguistics: ACL 2026, pages 2138–2153, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Solver-Independent Automated Problem Formulation via LLMs for High-Cost Simulation-Driven Design (Li et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.102.pdf
Checklist:
 2026.findings-acl.102.checklist.pdf