通过隐含引用绕过安全检测,90%成功率攻击大模型
You Know What I'm Saying: Jailbreak Attack via Implicit Reference
- 用多个无害目标隐含关联生成恶意内容
- 多数模型攻击成功率超90%,大模型更易受攻
- 适合研究模型安全与对抗攻击的读者
尽管大语言模型对齐技术已能有效识别包含场景嵌套和关键词重写的恶意目标,但本研究发现,这些方法仍无法检测通过嵌套无害目标中的上下文表达的恶意意图。我们揭示了一种此前未被关注的漏洞,称为隐含引用攻击(AIR)。该方法将恶意目标拆分为若干合规目标,并通过上下文中的隐含引用进行关联,利用多个相关无害目标生成恶意内容而不触发拒绝响应,从而有效绕过现有检测机制。实验表明,AIR在多款前沿大模型上均表现高效,对GPT-4o、Claude-3.5-Sonnet和Qwen-2-72B等模型的攻击成功率达90%以上。值得注意的是,我们观察到逆缩放现象:模型越大,越容易受到此攻击。此外,我们提出跨模型攻击策略,利用安全性较弱的模型生成恶意上下文,进一步提升对其他模型的攻击成功率。代码与攻击样本详见https://github.com/Lucas-TY/llm_Implicit_reference。
原文摘要 · Abstract (English)
While recent advancements in large language model (LLM) alignment have enabled the effective identification of malicious objectives involving scene nesting and keyword rewriting, our study reveals that these methods remain inadequate at detecting malicious objectives expressed through context within nested harmless objectives. This study identifies a previously overlooked vulnerability, which we term Attack via Implicit Reference (AIR). AIR decomposes a malicious objective into permissible objectives and links them through implicit references within the context. This method employs multiple related harmless objectives to generate malicious content without triggering refusal responses, thereby effectively bypassing existing detection techniques.Our experiments demonstrate AIR's effectiveness across state-of-the-art LLMs, achieving an attack success rate (ASR) exceeding 90% on most models, including GPT-4o, Claude-3.5-Sonnet, and Qwen-2-72B. Notably, we observe an inverse scaling phenomenon, where larger models are more vulnerable to this attack method. These findings underscore the urgent need for defense mechanisms capable of understanding and preventing contextual attacks. Furthermore, we introduce a cross-model attack strategy that leverages less secure models to generate malicious contexts, thereby further increasing the ASR when targeting other models.Our code and jailbreak artifacts can be found at https://github.com/Lucas-TY/llm_Implicit_reference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。