arXiv:2608.18360cs.SEcs.AI2026-08

多层控制机制需考虑修复操作的先后顺序影响,否则可能出错。

One Gate Is Not Enough: Composing Stateful Pre-Action Controls for Agentic AI

  • 提出修复后重新评估协议,解决多控制耦合问题
  • 发现两种修复操作不可交换,顺序影响系统行为
  • 适合研究智能体安全控制与系统设计的开发者

智能体AI系统在执行动作前受多重预动作控制(权限、资源、证据门)共同约束。本文聚焦修复引发的控制耦合:一个控制的修复可能改变另一控制评估的动作、证据或上下文,导致其先前判断失效。论文形式化该现象,并提出‘修复-重检’协议,在给定假设下恢复每步决策的正确性。进一步验证,两种实现的修复算子(证据替换与资源预算下调)不满足交换律,有限模型检测器找到了反例,说明修复顺序是控制平面语义的一部分而非实现细节。信任自身最近一次写入的受控证据缓冲区也存在类似状态问题:当前可接受不代表未来可信,易受未覆盖缺陷类污染;两种缓解措施可降低但无法消除风险。支持性结果包括:正权重线性聚合可抵消单个否决条件、跨控制统一证据集的可行性,以及组合不会新增检测覆盖范围。实验在包含三个未修改发布引擎的确定性开放数据样本上进行,CH1-CH5在全部30个预注册种子下均符合注册决策规则;CH6仅在较大工作流W1下成立,小工作流W2不成立,如实报告。本研究为开放负载数据上的机制演示,带有合成元数据层,非关于生产环境普遍性的主张。

原文摘要 · Abstract (English)

Agentic AI systems take consequential actions governed by more than one pre-action control at once: authority, resource, and evidence gates that can admit, degrade, or remediate an action before it executes. This paper's central object is remediation-induced control coupling: a remediation applied by one control can change the action, evidence, or context another control evaluates, invalidating that control's earlier judgment. We formalize this coupling and give a remediate-and-regate protocol that restores per-action soundness in the current bounded, idempotent setting under its stated assumptions. We further show that the two implemented remediation operators (evidence substitution and resource-budget downroute) do not commute -- a finite-model checker finds concrete counterexample instances -- making remediation order part of the control-plane semantics rather than an implementation detail. A governed evidence buffer that trusts its own most recent admitted write is a further instance of the same problem at the level of state -- current admissibility does not imply future reference trustworthiness -- and is vulnerable to poisoning from declared-uncovered defect classes; two mitigations reduce, not eliminate, that exposure. Supporting results establish the exact condition under which positive-weight linear aggregation of gate outcomes can compensate a member veto, a unified cross-control Evidence Set, and that composition manufactures no new detection coverage, reported honestly. Empirically, on a deterministic open-data artifact composing three published engines unmodified, CH1-CH5 meet their registered decision rules across all 30 pre-registered seeds; CH6 does so under W1 but not under the smaller W2 workflow, reported as such. This is a mechanism demonstration on open payload data with a synthetic metadata layer, not a claim about production prevalence.

智能体控制系统安全修复机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。