AutoUE: Automated Generation of 3D Games in Unreal Engine via Multi-Agent Systems
Lei Yin, Wentao Cheng, Zhida Qin, Tianyu Huang, Yidong Li, Gangyi Ding
Abstract
Automatically generating 3D games in commercial game engines remains a non-trivial challenge, as it involves complex engine-related workflows for generating assets such as scenes, blueprints, and code. To address this challenge, we propose a novel multi-agent system, AutoUE, which coordinates multiple agents to end-to-end generate 3D games, covering model retrieval, scene generation, gameplay and interaction code synthesis, and automated game testing for evaluation. In order to mitigate tool-use hallucinations in LLMs, we introduce a retrieval-augmented generation mechanism that grounds agents with relevant UE tool documentation. Additionally, we incorporate game design patterns and engine constraints into the code generation process to ensure the generation of correct and robust code. Furthermore, we design an automated play-testing pipeline that generates and executes runtime test commands, enabling systematic evaluation of dynamic behaviors. Finally, we construct a game generation dataset and conduct a series of experiments that demonstrate AutoUE’s ability to generate 3D games end-to-end, and validate the effectiveness of these designs.- Anthology ID:
- 2026.findings-acl.111
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2341–2364
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.111/
- DOI:
- Cite (ACL):
- Lei Yin, Wentao Cheng, Zhida Qin, Tianyu Huang, Yidong Li, and Gangyi Ding. 2026. AutoUE: Automated Generation of 3D Games in Unreal Engine via Multi-Agent Systems. In Findings of the Association for Computational Linguistics: ACL 2026, pages 2341–2364, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- AutoUE: Automated Generation of 3D Games in Unreal Engine via Multi-Agent Systems (Yin et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.111.pdf