Zero-Shot Detection of LLM-Generated Text using Temperature Sensitivity

Shixuan Ma, Jiahao Li, Zhendong Mao, Quan Wang


Abstract
The widespread deployment of Large Language Models (LLMs) has spurred significant progress in the detection of LLM-generated text. However, existing detection methods often rely on statistical features that are insufficient for reliable detection; for example, even though LLM-generated and human-written texts exhibit different probability distributions in surrogate models, they can produce nearly identical entropy values, thereby conflating the two types of text. In this paper, we propose that modulating the decoding temperature and monitoring how the probability distributions respond can better probe the intrinsic discrepancies between two types of text. Building upon this insight, we introduce a new feature termed Temperature Sensitivity (TS) and demonstrate that LLM-generated text tends to exhibit higher TS than human-written text. Finally, we propose NTS, a novel and simple zero-shot detector built upon normalized temperature sensitivity. Extensive experiments across three datasets, multiple domains, and various source models demonstrate the superior effectiveness and robustness of our proposed approach. Code avaliable at: https://github.com/Shixuan-Ma/NTS.
Anthology ID:
2026.acl-long.1748
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
37664–37679
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1748/
DOI:
Bibkey:
Cite (ACL):
Shixuan Ma, Jiahao Li, Zhendong Mao, and Quan Wang. 2026. Zero-Shot Detection of LLM-Generated Text using Temperature Sensitivity. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 37664–37679, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Zero-Shot Detection of LLM-Generated Text using Temperature Sensitivity (Ma et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1748.pdf
Checklist:
 2026.acl-long.1748.checklist.pdf