Kill two birds with one stone: generalized and robust AI-generated text detection via dynamic perturbations
Yinghan Zhou, Juan Wen, Wanli Peng, Xue Yiming, ZiWei Zhang, Wu Zhengxian
Abstract
The growing popularity of large language models has raised concerns regarding the potential to misuse AI-generated text (AIGT). It becomes increasingly critical to establish an excellent AIGT detection method with high generalization and robustness.While, existing methods either focus on model generalization or concentrate on robustness.The unified mechanism, to simultaneously address the challenges of generalization and robustness, is less explored. In this paper, we first empirically reveal an intrinsic mechanism for model generalization and robustness of AIGT detection task.Then, we proposed a novel AIGT detection method (DP-Net) via dynamic perturbations introduced by a reinforcement learning with elaborated reward and action.Experimentally, extensive results show that the proposed DP-Net significantly outperforms some state-of-the-art AIGT detection methods for generalization capacity in three cross-domain scenarios.Meanwhile, the DP-Net achieves best robustness under two text adversarial attacks.- Anthology ID:
- 2025.naacl-long.446
- Volume:
- Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
- Month:
- April
- Year:
- 2025
- Address:
- Albuquerque, New Mexico
- Editors:
- Luis Chiruzzo, Alan Ritter, Lu Wang
- Venue:
- NAACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 8864–8875
- Language:
- URL:
- https://preview.aclanthology.org/fix-sig-urls/2025.naacl-long.446/
- DOI:
- Cite (ACL):
- Yinghan Zhou, Juan Wen, Wanli Peng, Xue Yiming, ZiWei Zhang, and Wu Zhengxian. 2025. Kill two birds with one stone: generalized and robust AI-generated text detection via dynamic perturbations. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 8864–8875, Albuquerque, New Mexico. Association for Computational Linguistics.
- Cite (Informal):
- Kill two birds with one stone: generalized and robust AI-generated text detection via dynamic perturbations (Zhou et al., NAACL 2025)
- PDF:
- https://preview.aclanthology.org/fix-sig-urls/2025.naacl-long.446.pdf