@inproceedings{azim-etal-2025-autodspy,
    title = "{A}uto{DSP}y: Automating Modular Prompt Design with Reinforcement Learning for Small and Large Language Models",
    author = "Azim, Nafew  and
      Alam, Abrar Ur  and
      Omar, Hasan Bin  and
      Jami, Abdullah Mohammad Muntasir Adnan  and
      Ahad, Jawad Ibn  and
      Kabir, Muhammad Rafsan  and
      Hossain, Md. Ismail  and
      Rahman, Fuad  and
      Amin, Mohammad Ruhul  and
      Rahman, Shafin  and
      Mohammed, Nabeel",
    editor = "Potdar, Saloni  and
      Rojas-Barahona, Lina  and
      Montella, Sebastien",
    booktitle = "Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track",
    month = nov,
    year = "2025",
    address = "Suzhou (China)",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.emnlp-industry.192/",
    doi = "10.18653/v1/2025.emnlp-industry.192",
    pages = "2881--2896",
    ISBN = "979-8-89176-333-3",
    abstract = "Large Language Models (LLMs) excel at complexreasoning tasks, yet their performance hinges on the quality of their prompts and pipeline structures. Manual promptdesign, as used in frameworks like DSPy, poses significantlimitations: it is time-intensive, demands substantial expertise,and lacks scalability, restricting the widespread use of LLMsacross diverse applications. To overcome these challenges, weintroduce AutoDSPy, the first framework to fully automateDSPy pipeline construction using reinforcement learning (RL).AutoDSPy leverages an RL-tuned policy network to dynamicallyselect optimal reasoning modules{---}such as Chain-of-Thought forlogical tasks or ReAct for tool integration{---}along with inputoutput signatures and execution strategies, entirely eliminatingthe need for manual configuration. Experimental results on theGSM8K and HotPotQA benchmarks demonstrate that AutoDSPyoutperforms traditional DSPy baselines, achieving accuracy gainsof up to 4.3{\%} while reducing inference time, even with smallermodels like GPT-2 (127M). By integrating RL-based automation,AutoDSPy enhances both efficiency and accessibility, simplifyingthe development of structured, high-performing LLM solutionsand enabling scalability across a wide range of tasks"
}