通过量化文本扰动特征,提升对抗攻击下的生成文本检测能力
Modeling the Attack: Detecting AI-Generated Text by Quantifying Adversarial Perturbations
- 将文本标准化并计算与原始文本的差异度,用作检测信号
- 在1%误报率下,检测准确率达82.6%,远超传统方法的48.8%
- 适合需要高鲁棒性文本检测的应用场景
大型语言模型的快速发展带来了严重的双重用途风险,亟需可靠的AI生成文本检测系统。当前检测器极易受对抗攻击影响,尤其是改写类攻击可有效规避统计检测。本文首次对对抗鲁棒性进行对比研究,先量化标准对抗训练的局限性,再提出新型检测框架PIFE:通过多阶段归一化将输入文本转为标准形式,计算其与原文本的莱文斯坦距离和语义相似度等指标,直接输入分类器。我们评估了常规强化的Transformer与PIFE增强模型在字符、词、句级攻击下的表现。结果表明,传统对抗训练虽能抵御语法噪声,却在语义攻击下失效,即存在‘语义逃逸阈值’——在1%误报率下真正率仅48.8%。而PIFE模型通过显式建模扰动特征,将真正率提升至82.6%,有效防御最复杂的语义攻击。这证明,主动建模扰动痕迹比单纯训练更有利于实现真正的鲁棒性。
原文摘要 · Abstract (English)
The growth of highly advanced Large Language Models (LLMs) constitutes a huge dual-use problem, making it necessary to create dependable AI-generated text detection systems. Modern detectors are notoriously vulnerable to adversarial attacks, with paraphrasing standing out as an effective evasion technique that foils statistical detection. This paper presents a comparative study of adversarial robustness, first by quantifying the limitations of standard adversarial training and then by introducing a novel, significantly more resilient detection framework: Perturbation-Invariant Feature Engineering (PIFE), a framework that enhances detection by first transforming input text into a standardized form using a multi-stage normalization pipeline, it then quantifies the transformation's magnitude using metrics like Levenshtein distance and semantic similarity, feeding these signals directly to the classifier. We evaluate both a conventionally hardened Transformer and our PIFE-augmented model against a hierarchical taxonomy of character-, word-, and sentence-level attacks. Our findings first confirm that conventional adversarial training, while resilient to syntactic noise, fails against semantic attacks, an effect we term "semantic evasion threshold", where its True Positive Rate at a strict 1% False Positive Rate plummets to 48.8%. In stark contrast, our PIFE model, which explicitly engineers features from the discrepancy between a text and its canonical form, overcomes this limitation. It maintains a remarkable 82.6% TPR under the same conditions, effectively neutralizing the most sophisticated semantic attacks. This superior performance demonstrates that explicitly modeling perturbation artifacts, rather than merely training on them, is a more promising path toward achieving genuine robustness in the adversarial arms race.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。