用强化学习让AI文本骗过检测器,同时保持原意不变。
AuthorMist: Evading AI Text Detectors with Reinforcement Learning
- 用强化学习优化文本,让检测器难识别为AI生成
- 对多个检测器攻击成功率78.6%至96.2%,效果显著
- 适合关注文本隐私与对抗检测的研究者使用
在强大AI生成文本的时代,自动检测器被用来识别机器生成内容,这威胁到作者隐私与表达自由。本文提出AuthorMist,一种基于强化学习的系统,将AI生成文本转化为类人类写作风格。该系统以30亿参数语言模型为基础,通过组相对策略优化(GPRO)进行微调,实现能规避检测器的改写。框架采用外部检测器API(如GPTZero、WinstonAI、Originality.ai等)作为奖励函数,使模型在强化学习中持续学习更难被识别的输出。该方法可广泛应用于任何具备接口的检测器。实验在多个数据集和检测器上验证,结果表明AuthorMist显著降低文本可检测性,同时保持高语义相似度(>0.94)。对单个检测器的攻击成功率达78.6%至96.2%,远超基线改写方法。这些结果揭示了当前检测技术的局限性,并引发对检测-逃避对抗循环可持续性的思考。
原文摘要 · Abstract (English)
In the age of powerful AI-generated text, automatic detectors have emerged to identify machine-written content. This poses a threat to author privacy and freedom, as text authored with AI assistance may be unfairly flagged. We propose AuthorMist, a novel reinforcement learning-based system to transform AI-generated text into human-like writing. AuthorMist leverages a 3-billion-parameter language model as a backbone, fine-tuned with Group Relative Policy Optimization (GPRO) to paraphrase text in a way that evades AI detectors. Our framework establishes a generic approach where external detector APIs (GPTZero, WinstonAI, Originality.ai, etc.) serve as reward functions within the reinforcement learning loop, enabling the model to systematically learn outputs that these detectors are less likely to classify as AI-generated. This API-as-reward methodology can be applied broadly to optimize text against any detector with an accessible interface. Experiments on multiple datasets and detectors demonstrate that AuthorMist effectively reduces the detectability of AI-generated text while preserving the original meaning. Our evaluation shows attack success rates ranging from 78.6% to 96.2% against individual detectors, significantly outperforming baseline paraphrasing methods. AuthorMist maintains high semantic similarity (above 0.94) with the original text while successfully evading detection. These results highlight limitations in current AI text detection technologies and raise questions about the sustainability of the detection-evasion arms race.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。