Sachin Kumar Giroh
2025
<SYNTACT>: Structuring Your Natural Language SOPs into Tailored Ambiguity-Resolved Code Templates
Sachin Kumar Giroh
|
Pushpendu Ghosh
|
Aryan Jain
|
Harshal Giridhari Paunikar
|
Aditi Rastogi
|
Promod Yenigalla
|
Anish Nediyanchath
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track
This paper introduces <SYNTACT>, a three-stage multi agent LLM framework designed to transform unstructured and ambiguous Standard Operating Procedure (SOP) into a structured plan and an executable code template. Unstructured SOPs—common across industries such as finance, retail, and logistics—frequently suffer from ambiguity, missing information, and inconsistency, all of which hinder automation. SYNTACT addresses this through: (1) a Clarifier module that disambiguate the SOP using large language models, internal knowledge base (RAG) and human-in-the-loop , (2) a Planner that converts refined natural language instructions into a structured plan of hierarchical task flows through function (API) tagging, conditional branches and human-in-the-loop check-points, and (3) an Implementor that generates executable code fragments or pseudocode templates. We evaluate SYNTACT on real-world SOPs and synthetic variants, demonstrating an 88.4% end-to-end accuracy and a significant reduction in inconsistency compared to leading LLM baselines. Ablation studies highlight the necessity of each component, with performance dropping notably when modules are removed.Our findings show that structured multi-agent pipelines like SYNTACT can meaningfully improve consistency, reduce manual effort, and accelerate automation at scale.
Search
Fix author
Co-authors
- Pushpendu Ghosh 1
- Aryan Jain 1
- Anish Nediyanchath 1
- Harshal Giridhari Paunikar 1
- Aditi Rastogi 1
- show all...