arXiv:2602.09433cs.CRcs.AI2026-02被引 4

为AI自主执行动作设计实时安全管控系统,防止不可逆操作出错。

Autonomous Action Runtime Management(AARM):A System Specification for Securing AI-Driven Actions at Runtime

  • 拦截动作执行前进行上下文审查与策略校验
  • 支持四种实现架构,确保不同环境下的安全兼容
  • 适合需要高可靠性AI操作的工业、金融等关键领域

随着人工智能系统从被动助手演变为能执行重要行动的自主代理,安全边界已从模型输出转移到工具执行层面。传统安全模式——日志聚合、边界防御和事后取证——无法应对那些不可逆、以机器速度执行且源自可能被攻陷的编排层的AI行为。本文提出自主行动运行时管理(AARM),一个开放规范,用于在运行时保障AI驱动动作的安全。AARM定义了一套运行时安全系统:在动作执行前拦截、积累会话上下文、依据策略与意图对齐性评估、执行授权决策,并记录防篡改的取证凭证。我们形式化了针对提示注入、混淆代理攻击、数据外泄和意图漂移的威胁模型;提出一种动作分类框架,区分禁止类、依赖上下文拒绝类和依赖上下文允许类动作;设计了四种实现架构——协议网关、SDK嵌入、内核eBPF和厂商集成——具有不同的信任属性,并规定了AARM合规系统的最低符合要求。AARM与模型、框架和厂商无关,将动作执行视为稳定的安全部署边界。该规范旨在在专有系统碎片化导致互操作性丧失前,建立行业通用标准。

原文摘要 · Abstract (English)

As artificial intelligence systems evolve from passive assistants into autonomous agents capable of executing consequential actions, the security boundary shifts from model outputs to tool execution. Traditional security paradigms - log aggregation, perimeter defense, and post-hoc forensics - cannot protect systems where AI-driven actions are irreversible, execute at machine speed, and originate from potentially compromised orchestration layers. This paper introduces Autonomous Action Runtime Management (AARM), an open specification for securing AI-driven actions at runtime. AARM defines a runtime security system that intercepts actions before execution, accumulates session context, evaluates against policy and intent alignment, enforces authorization decisions, and records tamper-evident receipts for forensic reconstruction. We formalize a threat model addressing prompt injection, confused deputy attacks, data exfiltration, and intent drift. We introduce an action classification framework distinguishing forbidden, context-dependent deny, and context-dependent allow actions. We propose four implementation architectures - protocol gateway, SDK instrumentation, kernel eBPF, and vendor integration - with distinct trust properties, and specify minimum conformance requirements for AARM-compliant systems. AARM is model-agnostic, framework-agnostic, and vendor-neutral, treating action execution as the stable security boundary. This specification aims to establish industry-wide requirements before proprietary fragmentation forecloses interoperability.

AI安全运行时防护自主代理权限控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。