Xiaoqingdong
2025
Character is Destiny: Can Persona-assigned Language Models Make Personal Choices?
Rui Xu
|
Xintao Wang
|
Jiangjie Chen
|
Siyu Yuan
|
Xinfeng Yuan
|
Jiaqing Liang
|
Zulong Chen
|
Xiaoqingdong
|
Yanghua Xiao
Findings of the Association for Computational Linguistics: EMNLP 2025
Can Large Language Models (LLMs) simulate humans in making important decisions? Recent research has unveiled the potential of using LLMs to develop role-playing language agents (RPLAs), mimicking mainly the knowledge and tones of various characters. However, imitative decision-making necessitates a more nuanced understanding of personas. In this paper, we benchmark the ability of LLMs in persona-driven decision-making. Specifically, we investigate whether LLMs can predict characters’ decisions provided by the preceding stories in high-quality novels. Leveraging character analyses written by literary experts, we construct a dataset LIFECHOICE comprising 2,512 characters’ decision points from 470 books. Then, we conduct comprehensive experiments on LIFECHOICE with various LLMs and RPLA methodologies. The results demonstrate that state-of-the-art LLMs exhibit promising capabilities in this task, yet substantial room for improvement remains. Hence, we further propose the CHARMAP method, which adopts persona-based memory retrieval and significantly advances RPLAs on this task.
Search
Fix author
Co-authors
- Jiangjie Chen 1
- Zulong Chen 1
- Jiaqing Liang 1
- Xintao Wang 1
- Yanghua Xiao 1
- show all...