Challenging the Myth: A Research Arc on LLMs as Human Simulacra

Simon Münker, Achim Rettinger, Damian Trilling


Abstract
When Large Language Models (LLMs) combined with prompt-based approaches as human simulacra emerged, they promised revolutionary shortcuts. Models trained on vast internet corpora may replicate human behavior and communication through text-based alignment. The initial optimism of the NLP community positioned LLMs as universal human proxies capable of replacing participants in surveys, generating authentic social media content, and simulating diverse cultural perspectives. We systematically dismantle this "myth of universal generalization" and document a shift toward methodological rigor. Our research reveals fundamental limitations: LLMs exhibit inhuman response patterns in psychometric assessments and produce detectable synthetic content. We analyze the difference between superficial linguistic fluency and genuine human-like representation, and reframe the current paradigm from asking "can LLMs replace humans?" to "under what validated conditions might LLMs serve as useful research components in social sciences?" Our work shows how interconnected research efforts challenge foundational assumptions and establishes best practices for deploying LLMs as human simulacra.
Anthology ID:
2026.bigpicture-main.4
Volume:
Proceedings of The Big Picture v2: Crafting a Research Narrative
Month:
July
Year:
2026
Address:
San Diego, CA, USA
Editors:
Yanai Elazar, Allyson Ettinger, Nora Kassner, Sebastian Ruder
Venues:
BigPicture | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
31–44
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bigpicture-main.4/
DOI:
Bibkey:
Cite (ACL):
Simon Münker, Achim Rettinger, and Damian Trilling. 2026. Challenging the Myth: A Research Arc on LLMs as Human Simulacra. In Proceedings of The Big Picture v2: Crafting a Research Narrative, pages 31–44, San Diego, CA, USA. Association for Computational Linguistics.
Cite (Informal):
Challenging the Myth: A Research Arc on LLMs as Human Simulacra (Münker et al., BigPicture 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bigpicture-main.4.pdf