@inproceedings{zhang-etal-2026-logit,
    title = "Logit Arithmetic Elicits Long Reasoning Capabilities Without Training",
    author = "Zhang, Yunxiang  and
      Khalifa, Muhammad  and
      Zhang, Lechen  and
      Liu, Xin  and
      Lee, Ayoung  and
      Zhang, Xinliang Frederick  and
      Bayat, Farima Fatahi  and
      Wang, Lu",
    editor = "Liakata, Maria  and
      Moreira, Viviane P.  and
      Zhang, Jiajun  and
      Jurgens, David",
    booktitle = "Findings of the {A}ssociation for {C}omputational {L}inguistics: {ACL} 2026",
    month = jul,
    year = "2026",
    address = "San Diego, California, United States",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1249/",
    pages = "24943--24959",
    ISBN = "979-8-89176-395-1",
    abstract = "Large reasoning models exhibit long chain-of-thought reasoning with complex strategies such as backtracking and self-verification. Yet, these capabilities typically require resource-intensive post-training. We investigate whether such behaviors can be elicited in large models without any gradient updates. To this end, we propose a decoding-time approach, ThinkLogit, which utilizes logit arithmetic to transfer these capabilities from a substantially smaller reasoning guider to a large non-reasoning target. We further show that we can boost performance by training the guider to correct the target{'}s errors using preference optimization over mixed model outputs, a setup we refer to as ThinkLogit-DPO. We evaluate these methods across six reasoning benchmarks spanning math, science, and coding domains using the Qwen2.5-32B guided by R1-Distill-Qwen-1.5B, a model 21x smaller. Our experiments demonstrate that ThinkLogit and ThinkLogit-DPO achieve a relative improvement of 21.5{\%} and 24.2{\%}, respectively, over the target model. Moreover, ThinkLogit remains effective even when the guider and target come from different model families.Crucially, our method requires zero training for the large model and would incur minimal inference overhead when logits are computed in parallel, presenting a practical solution for enabling long reasoning at scale."
}