@inproceedings{xu-etal-2026-code-words,
    title = "Code over Words: Overcoming Semantic Inertia via Code-Grounded Reasoning",
    author = "Xu, Manjie  and
      Yin, Isabella  and
      Tu, Xinyi  and
      Zhang, Chi  and
      Zhu, Yixin",
    editor = "Liakata, Maria  and
      Moreira, Viviane P.  and
      Zhang, Jiajun  and
      Jurgens, David",
    booktitle = "Findings of the {A}ssociation for {C}omputational {L}inguistics: {ACL} 2026",
    month = jul,
    year = "2026",
    address = "San Diego, California, United States",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-acl/2026.findings-acl.819/",
    pages = "16610--16632",
    ISBN = "979-8-89176-395-1",
    abstract = "LLMs struggle with Semantic Inertia: the inability to inhibit pre-trained priors (e.g., ``Lava is Dangerous'') when dynamic, in-context rules contradict them. We probe this phenomenon using , where physical laws are mutable text rules, enabling precise evaluation of models' ability to override learned priors when rules change. We quantatively observe that larger models can exhibit inverse scaling: they perform worse than smaller models when natural language reasoning requires suppressing pre-trained associations (e.g., accepting ``Lava is Safe''). Our analysis attributes this to natural language encoding, which entangles descriptive semantics and logical rules, leading to persistent hallucinations of familiar physics despite explicit contradictory rules. Here we show that representing dynamics as executable code, rather than descriptive text, reverses this trend and enables effective prior inhibition. We introduce LCV, which fine-tunes models on counterfactual pairs and identifies states with contradictory rules, thereby forcing attention to logical constraints rather than visual semantics. This training-time approach outperforms expensive inference-time search methods in both efficiency and accuracy. Our results demonstrate that representation fundamentally determines whether scaling improves or impairs contextual reasoning. This challenges the assumption that larger models are universally better, with implications for domains that require dynamic overriding of learned priors."
}