arXiv:2502.12734cs.CRcs.CL2025-02ACL被引 15

用对抗训练提升生成文本检测器的抗攻击能力。

Iron Sharpens Iron: Defending Against Attacks in Machine-Generated Text Detection with Adversarial Training

  • 设计对抗框架GREATER,双向优化检测器与攻击者。
  • 在10种扰动和6类攻击下,攻击成功率降低0.67%。
  • 适合关注生成内容安全与模型鲁棒性的研究者。

机器生成文本(MGT)检测对网络内容监管至关重要。现有检测器虽性能强劲,但易受简单扰动和对抗攻击影响。本文从威胁建模视角出发,分析模型漏洞并探索有效防御策略。提出一种对抗训练框架GREATER,包含攻击者组件GREATER-A和检测器组件GREATER-D。GREATER-D学习抵御来自GREATER-A的攻击,并泛化到其他攻击;GREATER-A通过贪婪搜索与剪枝,在嵌入空间中识别关键词并生成隐蔽且破坏性强的对抗样本。两者同步更新,增强检测器对不同攻击强度的泛化防御能力。实验在10种文本扰动策略和6类对抗攻击下验证,GREATER-D相比当前最优防御方法将攻击成功率降低0.67%;同时,GREATER-A在效果与效率上均优于现有攻击方法。代码与数据集见https://github.com/Liyuuuu111/GREATER。

原文摘要 · Abstract (English)

Machine-generated Text (MGT) detection is crucial for regulating and attributing online texts. While the existing MGT detectors achieve strong performance, they remain vulnerable to simple perturbations and adversarial attacks. To build an effective defense against malicious perturbations, we view MGT detection from a threat modeling perspective, that is, analyzing the model's vulnerability from an adversary's point of view and exploring effective mitigations. To this end, we introduce an adversarial framework for training a robust MGT detector, named GREedy Adversary PromoTed DefendER (GREATER). The GREATER consists of two key components: an adversary GREATER-A and a detector GREATER-D. The GREATER-D learns to defend against the adversarial attack from GREATER-A and generalizes the defense to other attacks. GREATER-A identifies and perturbs the critical tokens in embedding space, along with greedy search and pruning to generate stealthy and disruptive adversarial examples. Besides, we update the GREATER-A and GREATER-D synchronously, encouraging the GREATER-D to generalize its defense to different attacks and varying attack intensities. Our experimental results across 10 text perturbation strategies and 6 adversarial attacks show that our GREATER-D reduces the Attack Success Rate (ASR) by 0.67% compared with SOTA defense methods while our GREATER-A is demonstrated to be more effective and efficient than SOTA attack approaches. Codes and dataset are available in https://github.com/Liyuuuu111/GREATER.

文本检测对抗训练安全防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。