Show or Tell? Modeling the evolution of request-making in Human-LLM conversations

Shengqi Zhu, Jeffrey Rzeszotarski, David Mimno


Abstract
Designing user-centered LLM systems requires understanding how people use them, but patterns of user behavior are often masked by the variability of queries. In this work, we introduce a new framework to describe request-making that segments user input into request content, roles assigned, query-specific context, and the remaining task-independent expressions. We apply the workflow to create and analyze a dataset of 211k real-world queries based on WildChat. Compared with similar human-human setups, we find significant differences in the language for request-making in the human-LLM scenario. Further, we introduce a novel and essential perspective of diachronic analyses with user expressions, which reveals fundamental and habitual user-LLM interaction patterns beyond individual task completion. We find that query patterns evolve from early ones emphasizing sole requests to combining more context later on, and individual users explore expression patterns but tend to converge with more experience. From there, we propose to understand communal trends of expressions underlying distinct tasks and discuss the preliminary findings. Finally, we discuss the key implications for user studies, computational pragmatics, and LLM alignment.
Anthology ID:
2026.findings-eacl.265
Volume:
Findings of the Association for Computational Linguistics: EACL 2026
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5023–5034
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.findings-eacl.265/
DOI:
Bibkey:
Cite (ACL):
Shengqi Zhu, Jeffrey Rzeszotarski, and David Mimno. 2026. Show or Tell? Modeling the evolution of request-making in Human-LLM conversations. In Findings of the Association for Computational Linguistics: EACL 2026, pages 5023–5034, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
Show or Tell? Modeling the evolution of request-making in Human-LLM conversations (Zhu et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.findings-eacl.265.pdf
Checklist:
 2026.findings-eacl.265.checklist.pdf