arXiv:2506.12274cs.CRcs.CL2025-06被引 4

用信息过载让大模型突破安全限制,无需添加恶意前缀。

InfoFlood: Jailbreaking Large Language Models with Information Overload

  • 通过语言重构使恶意请求变得复杂,诱导模型失效
  • 在4个主流模型上成功率提升至基线3倍
  • 连主流过滤系统也难以防御此类攻击

大型语言模型在各领域展现出强大能力,但其生成有害内容的潜在风险引发社会与监管关注,尤其在对抗性攻击(如越狱攻击)下更为突出。现有越狱方法通常通过添加精心设计的前缀或后缀来绕过模型内置安全机制。本文发现一种新漏洞:过度的语言复杂性可直接破坏模型的安全机制,无需任何附加文本,我们称此现象为信息过载。为此提出InfoFlood攻击方法,自动将恶意查询转化为信息过载型查询以实现越狱。该方法:(1) 使用语言变换重写恶意请求;(2) 识别失败原因;(3) 优化提示结构以修复问题并保持恶意意图。我们在GPT-4o、GPT-3.5-turbo、Gemini 2.0和LLaMA 3.1上验证其有效性,结果显示其在多个越狱基准测试中持续优于基线,成功率最高达3倍。此外,我们证明常见的后处理防御措施——包括OpenAI Moderation API、Perspective API和SmoothLLM——均无法有效缓解此类攻击,凸显传统安全防护在面对信息过载攻击时的严重缺陷。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains. However, their potential to generate harmful responses has raised significant societal and regulatory concerns, especially when manipulated by adversarial techniques known as "jailbreak" attacks. Existing jailbreak methods typically involve appending carefully crafted prefixes or suffixes to malicious prompts in order to bypass the built-in safety mechanisms of these models. In this work, we identify a new vulnerability in which excessive linguistic complexity can disrupt built-in safety mechanisms-without the need for any added prefixes or suffixes-allowing attackers to elicit harmful outputs directly. We refer to this phenomenon as Information Overload. To automatically exploit this vulnerability, we propose InfoFlood, a jailbreak attack that transforms malicious queries into complex, information-overloaded queries capable of bypassing built-in safety mechanisms. Specifically, InfoFlood: (1) uses linguistic transformations to rephrase malicious queries, (2) identifies the root cause of failure when an attempt is unsuccessful, and (3) refines the prompt's linguistic structure to address the failure while preserving its malicious intent. We empirically validate the effectiveness of InfoFlood on four widely used LLMs-GPT-4o, GPT-3.5-turbo, Gemini 2.0, and LLaMA 3.1-by measuring their jailbreak success rates. InfoFlood consistently outperforms baseline attacks, achieving up to 3 times higher success rates across multiple jailbreak benchmarks. Furthermore, we demonstrate that commonly adopted post-processing defenses, including OpenAI's Moderation API, Perspective API, and SmoothLLM, fail to mitigate these attacks. This highlights a critical weakness in traditional AI safety guardrails when confronted with information overload-based jailbreaks.

越狱攻击信息过载安全防护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。