arXiv:2608.09885cs.AIcs.CV2026-08被引 1

让AI助手的安全部件自动进化,应对新风险。

SHE: Trajectory-driven Safety Harness Evolution for LLM Agents

论文配图:SHE: Trajectory-driven Safety Harness Evolution for LLM Agents
图 1 · 摘自论文原文
  • 将安全组件拆解为四类,明确各自责任边界
  • 通过运行轨迹失败分析,实现安全边界的动态优化
  • 可迁移至不同模型,对未知风险有泛化能力

大语言模型(LLM)代理的安全不仅依赖于模型权重,还取决于管理上下文、记忆、工具和权限的安全部件。现有机制常将安全部件视为固定部署物,难以随新风险演进;且各组件功能耦合,导致安全责任难以追溯,限制局部优化。本文提出安全部件演化框架SHE,从运行轨迹中学习动态安全边界。SHE将安全部件分解为系统提示、规则库、安全记忆和工具策略四类,定义清晰的功能边界以支持局部演化。基于此,SHE构建归因引导的演化循环:将轨迹失败转化为结构化诊断,学习各组件的边界改进策略,并通过安全-效用验证筛选最优演化版本。在Agent-SafetyBench上的实验表明,相比静态安全框架SafeHarness,SHE实现3.1倍的有害行为率(ASR)降低,同时提升良性任务表现。演化后的安全部件还能在未见过的风险上保持良好泛化性,并跨模型迁移无需再演化。

原文摘要 · Abstract (English)

The safety of large language model (LLM) agents depends not only on model weights but also on the agent harness that manages context, memory, tools, permissions, and runtime control. Existing safety mechanisms often treat the harness as a fixed deployment artifact, limiting their ability to evolve with emerging risks. Moreover, coupled functions across harness components obscure safety responsibility attribution, making localized evolution difficult. We propose Safety Harness Evolution (SHE), a framework that learns evolving safe boundaries from rollout trajectories. SHE decomposes the harness into four artifacts with explicit safety responsibilities, including the System Prompt, Rule Bank, Safety Memory, and Tool Policy, defining clear functional boundaries for localized evolution. Based on this decomposition, SHE introduces an attribution-guided evolution loop that converts trajectory failures into structured diagnoses, learns artifact-specific boundary refinements, and selects evolved harnesses through safety-utility validation. Experiments on Agent-SafetyBench demonstrate that SHE effectively enhances safety through harness evolution, achieving a 3.1x ASR reduction compared with static SafeHarness, while also improving benign utility. The evolved harness further generalizes to unseen risks on the held-out AgentHarm benchmark and transfers across agent models without additional evolution.

LLM安全智能体演化自动化防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。