arXiv:2502.03052cs.LGcs.CR2025-02ICLR被引 28

提升越狱攻击迁移性,让漏洞检测更可靠

Understanding and Enhancing the Transferability of Jailbreaking Attacks

  • 通过均匀分散模型注意力,隐藏恶意意图令牌
  • 新方法在多个闭源模型上成功率超80%
  • 适合安全评估人员进行红队测试

越狱攻击能有效诱导开源大语言模型生成有害内容,但其迁移性有限,难以持续影响闭源模型。本文分析发现,攻击通过对抗序列干扰源模型的意图识别,使其忽略原始输入中的恶意意图标记,从而产生有害响应。然而,目标模型仍能重新聚焦于恶意意图标记并拒绝回应。进一步研究揭示,对抗序列的有效性源于对源模型参数的过拟合,导致迁移能力差。为此,提出感知重要性平滑(PiF)方法,将模型注意力均匀分布在中性意图标记上,无需依赖过拟合的对抗序列即可掩盖恶意意图。大量实验表明,PiF可高效、可靠地评估闭源模型的安全性。

原文摘要 · Abstract (English)

Jailbreaking attacks can effectively manipulate open-source large language models (LLMs) to produce harmful responses. However, these attacks exhibit limited transferability, failing to disrupt proprietary LLMs consistently. To reliably identify vulnerabilities in proprietary LLMs, this work investigates the transferability of jailbreaking attacks by analysing their impact on the model's intent perception. By incorporating adversarial sequences, these attacks can redirect the source LLM's focus away from malicious-intent tokens in the original input, thereby obstructing the model's intent recognition and eliciting harmful responses. Nevertheless, these adversarial sequences fail to mislead the target LLM's intent perception, allowing the target LLM to refocus on malicious-intent tokens and abstain from responding. Our analysis further reveals the inherent distributional dependency within the generated adversarial sequences, whose effectiveness stems from overfitting the source LLM's parameters, resulting in limited transferability to target LLMs. To this end, we propose the Perceived-importance Flatten (PiF) method, which uniformly disperses the model's focus across neutral-intent tokens in the original input, thus obscuring malicious-intent tokens without relying on overfitted adversarial sequences. Extensive experiments demonstrate that PiF provides an effective and efficient red-teaming evaluation for proprietary LLMs.

越狱攻击模型安全红队测试意图识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。