arXiv:2506.07001cs.CL2025-06NeurIPS被引 25

用对抗性改写让AI文本骗过检测,效果远超普通改写。

Adversarial Paraphrasing: A Universal Attack for Humanizing AI-Generated Text

  • 用检测器引导的指令模型自动改写AI文本,生成绕过检测的对抗样本。
  • 在多个检测系统上,误报率1%时真阳性下降超98%,平均降低87.88%。
  • 改写后文本质量基本不变,适合研究检测漏洞或提升防御能力者参考。

大语言模型能力增强引发对AI文本滥用(如抄袭、社交工程)的担忧。尽管已有多种检测方法,但多数易被简单改写绕过。本文提出对抗性改写(Adversarial Paraphrasing),一种无需训练的通用攻击框架,可有效使任意AI生成文本“更像人写”。该方法利用现成指令遵循模型,在AI文本检测器指导下进行改写,生成专门规避检测的对抗样本。实验表明,相比简单改写(反而使雷达检测器和Fast-DetectGPT的T@1%F分别提升8.57%和15.03%),本方法在OpenAI-RoBERTa-Large引导下,使RADAR的T@1%F下降64.49%,Fast-DetectGPT下降98.96%。在涵盖神经网络、水印、零样本等多种检测器的测试中,平均T@1%F下降87.88%。同时分析显示,攻击成功与文本质量之间存在微小权衡,整体质量损失轻微。结果凸显当前检测系统脆弱性,亟需更强防御策略。

原文摘要 · Abstract (English)

The increasing capabilities of Large Language Models (LLMs) have raised concerns about their misuse in AI-generated plagiarism and social engineering. While various AI-generated text detectors have been proposed to mitigate these risks, many remain vulnerable to simple evasion techniques such as paraphrasing. However, recent detectors have shown greater robustness against such basic attacks. In this work, we introduce Adversarial Paraphrasing, a training-free attack framework that universally humanizes any AI-generated text to evade detection more effectively. Our approach leverages an off-the-shelf instruction-following LLM to paraphrase AI-generated content under the guidance of an AI text detector, producing adversarial examples that are specifically optimized to bypass detection. Extensive experiments show that our attack is both broadly effective and highly transferable across several detection systems. For instance, compared to simple paraphrasing attack--which, ironically, increases the true positive at 1% false positive (T@1%F) by 8.57% on RADAR and 15.03% on Fast-DetectGPT--adversarial paraphrasing, guided by OpenAI-RoBERTa-Large, reduces T@1%F by 64.49% on RADAR and a striking 98.96% on Fast-DetectGPT. Across a diverse set of detectors--including neural network-based, watermark-based, and zero-shot approaches--our attack achieves an average T@1%F reduction of 87.88% under the guidance of OpenAI-RoBERTa-Large. We also analyze the tradeoff between text quality and attack success to find that our method can significantly reduce detection rates, with mostly a slight degradation in text quality. Our adversarial setup highlights the need for more robust and resilient detection strategies in the light of increasingly sophisticated evasion techniques.

对抗攻击文本检测LLM安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。