用动态扰动同时提升AI文本检测的泛化与抗攻击能力
Kill two birds with one stone: generalized and robust AI-generated text detection via dynamic perturbations
- 通过强化学习引入动态扰动,统一增强检测模型的泛化与鲁棒性
- 在三个跨域场景中超越主流方法,对抗两种文本攻击时表现最佳
- 适合需要高可靠性检测的场景,如内容审核与学术诚信审查
大语言模型的普及引发了对人工智能生成文本(AIGT)滥用的担忧。建立具备强泛化与鲁棒性的AIGT检测方法愈发关键。然而,现有方法通常只关注泛化或鲁棒性之一。本文提出将鲁棒性视为一种特定领域的分布偏移,并实证揭示了AIGT检测任务中模型泛化的内在机制。为此,我们设计了一种新方法DP-Net,通过强化学习引入精心设计奖励与动作的动态扰动。实验表明,DP-Net在三个跨域场景中显著优于现有先进检测方法,展现出更强的泛化能力;同时在两种文本对抗攻击下也达到最优鲁棒性。代码已公开于https://github.com/CAU-ISS-Lab/AIGT-Detection-Evade-Detection/tree/main/DP-Net。
原文摘要 · Abstract (English)
The growing popularity of large language models has raised concerns regarding the potential to misuse AI-generated text (AIGT). It becomes increasingly critical to establish an excellent AIGT detection method with high generalization and robustness. However, existing methods either focus on model generalization or concentrate on robustness. The unified mechanism, to simultaneously address the challenges of generalization and robustness, is less explored. In this paper, we argue that robustness can be view as a specific form of domain shift, and empirically reveal an intrinsic mechanism for model generalization of AIGT detection task. Then, we proposed a novel AIGT detection method (DP-Net) via dynamic perturbations introduced by a reinforcement learning with elaborated reward and action. Experimentally, extensive results show that the proposed DP-Net significantly outperforms some state-of-the-art AIGT detection methods for generalization capacity in three cross-domain scenarios. Meanwhile, the DP-Net achieves best robustness under two text adversarial attacks. The code is publicly available at https://github.com/CAU-ISS-Lab/AIGT-Detection-Evade-Detection/tree/main/DP-Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。