@inproceedings{cho-etal-2025-tuning,
    title = "Tuning-Free Personalized Alignment via Trial-Error-Explain In-Context Learning",
    author = "Cho, Hyundong Justin  and
      Sharma, Karishma  and
      Jedema, Nicolaas Paul  and
      Ribeiro, Leonardo F. R.  and
      May, Jonathan  and
      Moschitti, Alessandro",
    editor = "Chiruzzo, Luis  and
      Ritter, Alan  and
      Wang, Lu",
    booktitle = "Findings of the Association for Computational Linguistics: NAACL 2025",
    month = apr,
    year = "2025",
    address = "Albuquerque, New Mexico",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/Author-page-Marten-During-lu/2025.findings-naacl.326/",
    pages = "5864--5885",
    ISBN = "979-8-89176-195-7",
    abstract = "Language models are aligned to the collective voice of many, resulting in generic outputs that do not align with specific users' styles. In this work, we present Trial-Error-Explain In-Context Learning (TICL), a tuning-free method that personalizes language models for text generation tasks with fewer than 10 examples per user. TICL iteratively expands an in-context learning prompt via a trial-error-explain process, adding model-generated negative samples and explanations that provide fine-grained guidance towards a specific user`s style. TICL achieves favorable win rates on pairwise comparisons with LLM-as-a-judge up to 91.5{\%} against the previous state-of-the-art and outperforms competitive tuning-free baselines for personalized alignment tasks of writing emails, essays and news articles. Both lexical and qualitative analyses show that the negative samples and explanations enable language models to learn stylistic context more effectively and overcome the bias towards structural and formal phrases observed in their zero-shot outputs. By front-loading inference compute to create a user-specific in-context learning prompt that does not require extra generation steps at test time, presents a novel yet simple approach for personalized alignment."
}