@inproceedings{wu-etal-2026-superwriter,
    title = "{S}uper{W}riter: Reflection-Driven Long-Form Generation with Large Language Models",
    author = "Wu, Yuhao  and
      Bai, Yushi  and
      Hu, Zhiqiang  and
      Li, Juanzi  and
      Lee, Roy Ka-Wei",
    editor = "Liakata, Maria  and
      Moreira, Viviane P.  and
      Zhang, Jiajun  and
      Jurgens, David",
    booktitle = "Findings of the {A}ssociation for {C}omputational {L}inguistics: {ACL} 2026",
    month = jul,
    year = "2026",
    address = "San Diego, California, United States",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-acl/2026.findings-acl.428/",
    pages = "8790--8812",
    ISBN = "979-8-89176-395-1",
    abstract = "Long-form text generation remains a significant challenge for large language models (LLMs), particularly in maintaining coherence, ensuring logical consistency, and preserving text quality as sequence length increases. To address these limitations, we propose $\textit{SuperWriter}$-Agent, an agent-based framework designed to enhance the quality and consistency of long-form text generation. $\textit{SuperWriter}$-Agent introduces explicit structured thinking-through planning and refinement stages{---}into the generation pipeline, guiding the model to follow a more deliberate and cognitively grounded process akin to that of a professional writer. Based on this framework, we construct a supervised fine-tuning dataset to train a 7B $\textit{SuperWriter}$-LM. We further develop a hierarchical Direct Preference Optimization (DPO) procedure that uses Monte Carlo Tree Search (MCTS) to propagate final quality assessments and optimize each generation step accordingly. Empirical results across diverse benchmarks demonstrate that $\textit{SuperWriter}$-LM achieves state-of-the-art performance, surpassing even larger-scale baseline models in both automatic evaluation and human evaluation. Furthermore, comprehensive ablation studies demonstrate the effectiveness of hierarchical DPO and underscore the value of incorporating structured thinking steps to improve the quality of long-form text generation."
}