arXiv:2608.27141cs.CRcs.AI2026-08

让大模型代理保持持续安全状态,突破传统安全机制的循环局限。

Safety Does Not Compose: Non-Decaying Loop State for Autonomous LLM Agents

论文配图:Safety Does Not Compose: Non-Decaying Loop State for Autonomous LLM Agents
图 1 · 摘自论文原文
  • 设计跨迭代持久安全状态,避免每次重启重置安全判断。
  • 证明单一轨迹监控无法区分真实攻击与误报,而新方法可完美分离。
  • 适用于高风险自主系统,如金融、医疗等需长期可信运行的场景。

大型语言模型代理正被越来越多地部署为自主循环系统。从一个初始人类目标出发,系统反复执行任务发现、规划、工具调用、结果验证,并在多次无人值守迭代中持续维护状态。然而,当前广泛采用的安全机制仅作用于单个轨迹,每当新轨迹开始时安全状态即被重置。本文揭示这是组合性失败,而非实现细节。核心结论是:对于证据分散在多个迭代中的攻击,任何基于单轨迹的监控器其真正率等于假正率,无论表达能力多强——因为它所依赖的证据永远不在其观察窗口内;而保留跨迭代状态的监控器则能完美分离两者。进一步表明,简单采用几何衰减的风险评分修复无效,因患者对手的等待冷却期是常数,不随时间跨度 $N$ 增长。为此提出 LoopHarness,实现循环级别的持久、非衰减安全状态。在中介提交和仲裁检测下限 $δ_M$ 条件下,其预期未授权不可逆操作次数被限制为 $B+m-1+m/δ_M$,该值与 $N$ 无关,其中 $B+m-1$ 项由无模型规则决定,因此即使验证者完全合谋也依然有效。提供了完整的评估协议,涵盖 Agent-SafetyBench 原生任务的干净与受攻击配对样本、依赖跨迭代证据的外部状态攻击套件、模块级消融实验及自适应白盒红队测试。

原文摘要 · Abstract (English)

Large language model agents are increasingly deployed as autonomous loops. Starting from one human goal, such a system repeatedly discovers work, plans, executes tool calls, verifies outcomes and persists state across many unattended iterations. The agent safeguards in wide use, however, are defined over a single trajectory, and their safety state is re-initialized when the next trajectory begins. We show that this is a failure of composition rather than an implementation detail. Our central result is a separation: against an attack whose evidence is fragmented across several iterations, every trajectory-scoped monitor has a true-positive rate equal to its false-positive rate, however expressive it is, because the evidence it would need never appears in the window it sees, whereas a monitor retaining cross-iteration state separates the two perfectly. We further show that the obvious repair of carrying a geometrically decaying risk score is insufficient, because the cooling-off period a patient adversary must wait is a constant that does not grow with the horizon $N$. We then present LoopHarness, which restores a persistent, non-decaying safety state at the loop level. Under mediated commits and an arbiter detection floor $δ_M$, it bounds the expected number of unauthorized irreversible actions by $B+m-1+m/δ_M$, a constant in $N$, of which the $B+m-1$ term is decided by a model-free rule and therefore survives a fully colluding verifier. We give a complete evaluation protocol on native Agent-SafetyBench tasks with paired clean and attacked episodes, an outer-state attack suite whose decisive evidence exists only across iterations, per-module ablations, and an adaptive white-box red team.

大模型代理安全机制持续状态对抗攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。