arXiv:2605.09504cs.CRcs.AI2026-05

用轻量级模型群实现低成本攻破大模型安全与软件漏洞

AI Security Policy Should Assess Systems, Not Only Models

  • 多个小模型通过共享内存协同探索,形成攻击集群
  • 4分钟内发现9个漏洞,100%召回率;对GPT-4o有效害率45.8%
  • 系统架构是关键,适合安全评估与红队测试人员参考

我们提出swarm-attack,一个开源对抗性测试框架,其中多个轻量级LLM代理通过共享内存、并行探索和进化优化协同工作。实验表明,前沿模型的安全绕过和软件漏洞发现——即促使Anthropic限制发布Mythos Preview的能力类别——可在消费级硬件上以近乎零成本实现,仅使用公开模型。第一组实验中,五个12亿参数模型各对GPT-4o和Claude Sonnet-4发起225次越狱攻击:对GPT-4o,有效危害率为45.8%,造成49次严重级别违规;对Claude Sonnet-4,技术成功率40%,但有效危害率为0%。第二组实验中,相同模型联合进行源码分析与二进制模糊测试,针对含9个预设CWE的C程序,结合手工构造的利用种子库、正则匹配检测与AddressSanitizer崩溃分类,约4分钟内成功恢复全部9个漏洞(100%召回率);关闭这些组件后,仅通过崩溃验证找回0个,引用检测找回2个。因此,该能力类别可被低成本复现,核心在于系统架构本身,其弥补了单个模型推理能力的局限。

原文摘要 · Abstract (English)

We present swarm-attack, an open-source adversarial testing framework in which multiple lightweight LLM agents coordinate through shared memory, parallel exploration, and evolutionary optimization. Together, our results demonstrate that both safety bypass of frontier models and software vulnerability discovery, i.e., the capability class that motivated restricted release of Anthropic's Mythos Preview, are achievable at effectively zero cost using commodity hardware and openly available models. We report two experiments. In the first, five instances of a 1.2 billion parameter model conducted 225 jailbreak attacks each against GPT-4o and Claude Sonnet~4. Against GPT-4o, the swarm achieved an Effective Harm Rate of 45.8%, producing 49 critical-severity breaches; against Claude Sonnet-4, the Effective Harm Rate was 0% despite a 40% technical success rate. In the second experiment, the same models performed combined source code analysis and binary fuzzing against a vulnerable C application with 9 planted CWEs. With a hand-crafted exploit seed corpus, regex pattern detection, and AddressSanitizer-based crash classification, the pipeline recovers 9 of 9 vulnerabilities (100% recall) in approximately four minutes on a consumer MacBook. With those scaffold components disabled, the same model recovers 0 of 9 by crash verification and 2 of 9 by citation. The capability class that motivated restricted release of Anthropic's Mythos Preview is therefore reproducible at effectively zero cost; the important enabler is the system scaffold itself, which compensates for the limited reasoning capacity of small individual models.

AI安全对抗攻击漏洞挖掘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。