PURE: Post-hoc Unlocking and REfinement for Discrete Diffusion Decoding

Yangryeol Park, Kunhui Lee, Hanback Choi, Cheoneum Park, Donghyeon Jeon, Inho Kang, Seung-Hoon Na


Abstract
Masked diffusion language models (MDLMs) enable efficient parallel decoding but are limited by a monotonic unmasking policy, where committed tokens cannot be revised. While remasking-based methods mitigate early errors, they mainly intervene during generation. In this work, we study post-hoc refinement of a completed draft and find that naive correction often fails because of contextual lock-in, a phenomenon in which local error patterns become self-reinforcing. To address this, we propose PURE (Post-hoc Unlocking and REfinement), a training-free inference algorithm for two-phase decoding. PURE profiles confidence dynamics during drafting to identify unstable regions via an instability score (𝛥i), then unlocks them through deterministic window masking and stochastic leftward relaxation. On reasoning benchmarks, PURE substantially improves accuracy when applied to LLaDA-8B-Instruct, including a gain of +12.9 points over the baseline on GSM8K. These gains require only a small refinement budget, yielding a favorable compute-quality trade-off for discrete diffusion decoding.
Anthology ID:
2026.findings-acl.1234
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
24653–24667
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1234/
DOI:
Bibkey:
Cite (ACL):
Yangryeol Park, Kunhui Lee, Hanback Choi, Cheoneum Park, Donghyeon Jeon, Inho Kang, and Seung-Hoon Na. 2026. PURE: Post-hoc Unlocking and REfinement for Discrete Diffusion Decoding. In Findings of the Association for Computational Linguistics: ACL 2026, pages 24653–24667, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
PURE: Post-hoc Unlocking and REfinement for Discrete Diffusion Decoding (Park et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1234.pdf
Checklist:
 2026.findings-acl.1234.checklist.pdf