arXiv:2511.07645cs.SEcs.AI2025-11

让大模型自动发现并应对安全威胁,无需重训即可自我强化防御。

A Self-Improving Architecture for Dynamic Safety in Large Language Models

  • 构建闭环系统,实时检测漏洞并生成双机制防御策略。
  • 平均攻击成功率降至0.27%,未见攻击拦截率达68.5%。
  • 适合追求动态安全的AI系统开发者与安全研究人员。

大型语言模型依赖静态、部署前的安全机制,无法应对上线后发现的对抗性威胁。本文提出自适应安全框架SISF,基于MAPE-K参考模型,将目标LLM与反馈回路结合:裁判模块检测安全违规,策略生成模块设计启发式与语义双重防御策略,守卫模块执行策略。在四个模型家族上开展七项实验(共10,061次评估)。五次可复现试验中,SISF平均攻击成功率(ASR)为0.27%(±0.15%),每轮自动生成240条策略。跨模型测试验证了部署可移植性。留出测试集显示对未知攻击的主动拦截率达68.5%。叠加于Llama Guard 4后,残余ASR从7.88%降至0.00%。消融实验证明两类策略均不可或缺。结论:自适应架构是实现大模型安全的有效路径。SISF通过同步输出监控,借助MAPE-K循环逐步将防护转向快速本地化守卫策略,为构建鲁棒人工智能系统提供新范式。

原文摘要 · Abstract (English)

Context: Large Language Models (LLMs) rely on static, pre-deployment safety mechanisms that cannot adapt to adversarial threats discovered after release. Objective: To design a software architecture enabling LLM-based systems to autonomously detect safety failures and synthesize defense policies at runtime, without retraining or manual intervention. Method: We propose the Self-Improving Safety Framework (SISF), grounded in the MAPE-K reference model. The framework couples a target LLM with a feedback loop: an Adjudicator detects breaches, a Policy Synthesis Module generates dual-mechanism defense policies (heuristic and semantic), and a Warden enforces them. We conducted seven experiments (10,061 evaluations) across four model families. Results: Across five reproducibility trials, SISF achieved a mean Attack Success Rate (ASR) of 0.27% (+/-0.15%), autonomously generating 240 policies per trial. Cross-model evaluation confirmed deployment portability. A held-out test showed a 68.5% proactive interception rate on unseen attacks. Stacked behind Llama Guard 4, the combined defense reduced residual ASR from 7.88% to 0.00%. Ablation confirmed both heuristic and semantic policy types are architecturally required. Conclusion: Self-adaptive architecture is a viable approach to LLM safety. SISF achieves sub-1% ASR through synchronous output monitoring, progressively shifting enforcement to fast, local Warden policies via the MAPE-K loop, offering a new pattern for building resilient AI systems.

大模型安全自适应防御动态检测MAPE-K

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。