Kill two birds with one stone: generalized and robust AI-generated text detection via dynamic perturbations

Yinghan Zhou, Juan Wen, Wanli Peng, Xue Yiming, ZiWei Zhang, Wu Zhengxian


Abstract
The growing popularity of large language models has raised concerns regarding the potential to misuse AI-generated text (AIGT). It becomes increasingly critical to establish an excellent AIGT detection method with high generalization and robustness.While, existing methods either focus on model generalization or concentrate on robustness.The unified mechanism, to simultaneously address the challenges of generalization and robustness, is less explored. In this paper, we first empirically reveal an intrinsic mechanism for model generalization and robustness of AIGT detection task.Then, we proposed a novel AIGT detection method (DP-Net) via dynamic perturbations introduced by a reinforcement learning with elaborated reward and action.Experimentally, extensive results show that the proposed DP-Net significantly outperforms some state-of-the-art AIGT detection methods for generalization capacity in three cross-domain scenarios.Meanwhile, the DP-Net achieves best robustness under two text adversarial attacks.
Anthology ID:
2025.naacl-long.446
Volume:
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Month:
April
Year:
2025
Address:
Albuquerque, New Mexico
Editors:
Luis Chiruzzo, Alan Ritter, Lu Wang
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8864–8875
Language:
URL:
https://preview.aclanthology.org/fix-sig-urls/2025.naacl-long.446/
DOI:
Bibkey:
Cite (ACL):
Yinghan Zhou, Juan Wen, Wanli Peng, Xue Yiming, ZiWei Zhang, and Wu Zhengxian. 2025. Kill two birds with one stone: generalized and robust AI-generated text detection via dynamic perturbations. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 8864–8875, Albuquerque, New Mexico. Association for Computational Linguistics.
Cite (Informal):
Kill two birds with one stone: generalized and robust AI-generated text detection via dynamic perturbations (Zhou et al., NAACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-sig-urls/2025.naacl-long.446.pdf