StructuThink: Reasoning with Task Transition Knowledge for Autonomous LLM-Based Agents

Haiyu Zhao, Zhenyu Guo, Chunhong Zhang, Ziyu Zhou, Zheng Hu


Abstract
Decision-making tasks have highlighted fundamental challenges in grounding decisions within real-world contexts. Traditional decision knowledge utilization methods often struggle to effectively integrate structured decision constraints, limiting their ability to decompose high-level tasks, maintain logical consistency, and adapt to dynamic environments. To bridge this gap, we introduce StructuThink, a knowledge-structured reasoning framework that enhances LLM-based agents with explicit decision constraints. Specifically, we propose the Task Transition Knowledge Graph (TTKG) that learning decision knowledge in embodied scenarios. Leveraging this knowledge, we propose the StructuThink framework, comprising a subtask chain constructor for grounding natural language instructions and a constraint-based executor for adaptive and consistent decision-making. We validate StructuThink across multiple benchmarks, including ALFWorld and WebShop, where it achieves higher task success rates (improving by up to 7%) and more efficient action sequences (requiring up to 15% fewer steps) than baseline methods. Our approach enables LLMs to more effectively ground decision-making in domain-specific scenarios, enhancing both interpretability and reliability, thus paving the way for more reliable and adaptable decision-making systems.
Anthology ID:
2025.findings-emnlp.1331
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
24489–24506
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.1331/
DOI:
10.18653/v1/2025.findings-emnlp.1331
Bibkey:
Cite (ACL):
Haiyu Zhao, Zhenyu Guo, Chunhong Zhang, Ziyu Zhou, and Zheng Hu. 2025. StructuThink: Reasoning with Task Transition Knowledge for Autonomous LLM-Based Agents. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 24489–24506, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
StructuThink: Reasoning with Task Transition Knowledge for Autonomous LLM-Based Agents (Zhao et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.1331.pdf
Checklist:
 2025.findings-emnlp.1331.checklist.pdf