From Script to Stage: Automating Experimental Design for Social Simulations with LLMs
Yuwei Guo, Zihan Zhao, Xiaowei Liu, Xiangning Yu, Qun Ma, Deyu Zhou, Xiao Xue
Abstract
Multi-agent simulation based on LLMs has increasingly emerged as a new paradigm for exploring complex social phenomena and validating theoretical hypotheses. However, traditional experimental design in the social sciences relies heavily on interdisciplinary expert knowledge, involving cumbersome procedures and high technical barriers. While LLM-driven agents demonstrate broad prospects for designing experiments, their limitations regarding reliability and scientific rigor continue to significantly hinder their in-depth application in social science research. To address these challenges, this paper proposes FSTS, an automated framework for multi-agent experiment design based on script generation. Drawing on the concept of the "Decision Theater," the framework deconstructs experimental design into three core phases: Script Composition, Script Finalization, and Actor Generation. Tests across multiple scenarios indicate that the agents generated by this framework can enact the script within the "experimental theater," reproducing results consistent with real-world situations. The proposal of FSTS not only effectively lowers the barrier for social science experimental design but also provides scientifically grounded decision support for policy-making.- Anthology ID:
- 2026.findings-acl.780
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 15897–15916
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.780/
- DOI:
- Cite (ACL):
- Yuwei Guo, Zihan Zhao, Xiaowei Liu, Xiangning Yu, Qun Ma, Deyu Zhou, and Xiao Xue. 2026. From Script to Stage: Automating Experimental Design for Social Simulations with LLMs. In Findings of the Association for Computational Linguistics: ACL 2026, pages 15897–15916, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- From Script to Stage: Automating Experimental Design for Social Simulations with LLMs (Guo et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.780.pdf