HintPilot: LLM-based Compiler Hint Synthesis for Code Optimization

Hanyun Jiang, Peisen Yao, Kaiyue Li, Tingting Lin, Chengpeng Wang, Kui Ren


Abstract
Code optimization remains a core objective in software development, yet modern compilers struggle to navigate the enormous optimization spaces. While recent research has looked into employing large language models (LLMs) to optimize source code directly, these techniques can introduce semantic errors and miss fine-grained compiler-level optimization opportunities. We present HintPilot, which bridges LLM-based reasoning with traditional compiler infrastructures via synthesizing compiler hints—annotations that steer compiler behavior. HintPilot employs retrieval-augmented synthesis over compiler documentation and applies profiling-guided iterative refinement to synthesize semantics-preserving and effective hints. Upon PolyBench and HumanEval-CPP benchmarks, HintPilot achieves up to 6.88x geometric mean speedup over while preserving program correctness.
Anthology ID:
2026.findings-acl.1251
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
24970–24986
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1251/
DOI:
Bibkey:
Cite (ACL):
Hanyun Jiang, Peisen Yao, Kaiyue Li, Tingting Lin, Chengpeng Wang, and Kui Ren. 2026. HintPilot: LLM-based Compiler Hint Synthesis for Code Optimization. In Findings of the Association for Computational Linguistics: ACL 2026, pages 24970–24986, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
HintPilot: LLM-based Compiler Hint Synthesis for Code Optimization (Jiang et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1251.pdf
Checklist:
 2026.findings-acl.1251.checklist.pdf