arXiv:2608.26008cs.CRcs.CL2026-08

用可自进化记忆防御大模型越狱攻击,不更新参数也能越打越强。

A Self-Evolving Multi-Agent Framework Defense against LLM Jailbreak Attacks

论文配图:A Self-Evolving Multi-Agent Framework Defense against LLM Jailbreak Attacks
图 1 · 摘自论文原文
  • 通过外部记忆存储攻击模式,抽象为通用规则应对新攻击
  • 在4类越狱攻击中成功率下降超90%,且不降低正常功能
  • 无需训练,适配开源与黑盒模型,适合长期部署的防护系统

大型语言模型仍易受越狱攻击,此类攻击利用角色扮演、混淆、代码转换和多步绕过等手段诱导有害输出。随着攻击策略不断演化,现有防御多为静态,部署后无法积累经验或适应未知攻击。本文提出一种基于持续交互式规则记忆的自进化测试时防御框架:当攻击成功时,系统将失败抽象为方法级规则,捕捉攻击结构而非有害内容,并复用于后续输入。由于规则具有方法层级泛化性,单一规则可覆盖整个攻击家族,标签空间随新封装方式出现而扩展。该机制完全依赖外部记忆与提示完成,无需参数更新,适用于开放权重与黑盒API模型。我们实现为四个协作模块,但核心贡献在于记忆驱动的适应机制。在四类黑盒越狱攻击及多个模型上,本方法显著降低攻击成功率,保持良性功能,对自适应复合封装攻击仍具鲁棒性,且内存增长不导致过度拒绝。

原文摘要 · Abstract (English)

Large language models (LLMs) remain vulnerable to jailbreak attacks that exploit techniques such as role-playing, obfuscation, code transformation, and multi-step indirection to elicit harmful outputs. As jailbreak strategies keep emerging, defenses have proliferated in an ongoing cat-and-mouse game, yet most remain static: their safety behavior is fixed at deployment, so they cannot accumulate defensive experience or adapt to unseen strategies. We propose a self-evolving test-time defense built around a persistent, cross-interaction rule memory: when an attack succeeds, the framework abstracts that failure into a method-level rule capturing the structural attack wrapper rather than the harmful topic, and reuses it against future inputs. Because rules are method-level, one induced rule generalizes across an entire attack family, and the label space expands as novel wrappers appear. The mechanism operates entirely through external memory and prompting, with no parameter updates, and applies to both open-weight and black-box API models. We realize it as four cooperating modules, but the contribution is the memory-based adaptation mechanism, not the module decomposition. Across four black-box jailbreak families and multiple models, our method substantially reduces attack success rates while preserving benign utility, remains robust under an adaptive composite-wrapper attack, and does not increase over-refusal as the memory grows.

大模型安全越狱防御自进化记忆机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。