arXiv:2608.08471cs.AI2026-08

让安全防护系统自动进化,实时应对新型越狱攻击。

Yesterday's Shield, Today's Spear: A Self-Evolving Safety Guardrail in Production

论文配图:Yesterday's Shield, Today's Spear: A Self-Evolving Safety Guardrail in Production
图 1 · 摘自论文原文
  • 构建多智能体系统,利用模型自身错误生成针对性训练数据。
  • 6轮迭代中,1.7B模型16-24小时完成升级,仅需2小时人工介入。
  • 已在生产环境落地,两个月内闭环14个新威胁,适合高危场景部署者。

已部署的大语言模型安全防护机制大多静态:训练一次后冻结,而新型越狱手段和未覆盖的有害内容类别在数日内不断涌现,导致防御始终滞后。我们提出SESG(自演化安全护栏),一个在生产环境中运行的多智能体系统。SESG监控上线流量,识别两类失效:形式新颖的越狱攻击与内容新颖的有害类别。确认失败后,生成代理针对该问题合成配对训练数据;验证代理根据部署模型的错误方向重新平衡数据批次,使模型自身失误引导训练集;路由代理将训练动作匹配至诊断出的漏洞,并将新版返回生产环境。在六轮实际演进(V0至V6)中,1.7B规模的护栏可在16-24小时内响应新威胁,仅需约2小时人工投入,相较替代的40-90小时人工流程显著提升效率。在六个新兴威胁上,其性能超越0.6B至9B的静态护栏及一个自适应基线,同时保持通用筛选能力。自2026年4月起,SESG已成为 Sangfor 安全护栏的主要更新管道,两个月内自主闭环14个新威胁场景。我们已在 https://github.com/Trams1017/SESG 公开9个测试集,涵盖6个新威胁。警告:本文包含可能有害或冒犯性内容。

原文摘要 · Abstract (English)

Deployed LLM safety guardrails are predominantly static: trained once and frozen at release, while new jailbreak techniques and previously un-addressed harmful categories emerge within days, leaving the defense perpetually a step behind. We present SESG (Self-Evolving Safety Guardrails), a multi-agent system running in production. SESG monitors the live traffic behind a deployed guardrail and surfaces two classes of failure: jailbreaks novel in form and harmful categories novel in content. Once a failure is confirmed, a generation agent synthesizes paired training data targeted at it; a validation agent rebalances the batch toward the direction in which the deployed model errs, so that the model's own mistakes steer its training set; and a routing agent matches the training action to the diagnosed gap and returns the next version to production. Over six rounds of live evolution (V0 to V6), a 1.7B guardrail adapts to a new threat in 16-24 hours, with about 2 hours of human effort, versus the 40-90 hours of the manual process it replaces. On six emerging threats, it outperforms static guardrails from 0.6B to 9B and an adaptive baseline while preserving its general screening competence. Since April 2026, SESG has been the primary update pipeline of Sangfor's guardrail, autonomously closing 14 of 15 new threat scenarios in two months. We release 9 test sets for the 6 new threats at https://github.com/Trams1017/SESG. Warning: This paper contains examples that may be harmful or offensive.

安全防护自演化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。