Learning to Retrieve User History and Generate User Profiles for Personalized Persuasiveness Prediction

Sejun Park, Yoonah Park, Jongwon Lim, Yohan Jo


Abstract
Estimating the persuasiveness of messages is critical in various applications, from recommender systems to safety assessment of LLMs. While it is imperative to consider the target persuadee’s characteristics, such as their values, experiences, and reasoning styles, there is currently no established systematic framework to optimize leveraging a persuadee’s past activities (e.g., conversations) to the benefit of a persuasiveness prediction model. To address this problem, we propose a context-aware user profiling framework with two trainable components: a query generator that generates optimal queries to retrieve persuasion-relevant records from a user’s history, and a profiler that summarizes these records into a profile to effectively inform the persuasiveness prediction model.Our evaluation on the ChangeMyView Reddit dataset shows consistent improvements over existing methods across multiple predictor models, raising F1 from 33% to 47% on Llama-3.3-70B-Instruct. Further analysis shows that effective user profiles are context-dependent and predictor-specific, rather than relying on static attributes or surface-level similarity. Together, these results highlight the importance of task-oriented, context-dependent user profiling for personalized persuasiveness prediction.
Anthology ID:
2026.findings-acl.858
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
17338–17359
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.858/
DOI:
Bibkey:
Cite (ACL):
Sejun Park, Yoonah Park, Jongwon Lim, and Yohan Jo. 2026. Learning to Retrieve User History and Generate User Profiles for Personalized Persuasiveness Prediction. In Findings of the Association for Computational Linguistics: ACL 2026, pages 17338–17359, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Learning to Retrieve User History and Generate User Profiles for Personalized Persuasiveness Prediction (Park et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.858.pdf
Checklist:
 2026.findings-acl.858.checklist.pdf