提出可量化风险的框架,让智能体故障路径变透明、风险可计算。
From Agent Failure Paths to Quantified Residual Risk: A Compositional Framework for Resilient Agentic AI

- 构建七层分解框架,从物理状态到时间全面覆盖故障路径。
- 设计函数模型将每条故障路径映射为具体风险值,精度可验证。
- 适合需要高可靠性与可解释性的机器人和金融智能体系统。
智能体人工智能正以超出现有风险模型表征的速度跨越信任边界。现有方法要么描述故障机制但无法生成可迁移的残余风险估计,要么给出风险值却将内部故障路径视为黑箱。本文提出CPSAINT框架,包含物理状态、传感器、数据、计算、执行器、环境和时间七个层级,并搭配FRIESA-K函数,将每条故障路径映射为可量化的风险实例。该函数通过受控吸收马尔可夫模型定义抗性项K,使控制有效性由状态动态推导而非主观赋值。结果形成从机制到数值的完整管道,支持鲁棒智能体与具身AI的可信设计。治理可观测性通过独立加性惩罚实现,不嵌入抗性函数。框架在两类场景中验证:硬实时仓库机器人与带治理功能的金融代理,相同层级语义与动态抗性构造保持一致,展现出跨领域推理能力、明确假设与可量化可组合的信任形式化基础。
原文摘要 · Abstract (English)
Agentic AI is crossing trust boundaries faster than current risk models can represent. Existing approaches provide one of two partial views. They either describe failure mechanisms without producing a transferable residual-risk estimate, or they produce a risk estimate while treating the internal failure path as a black box. We couple those two views by proposing CPSAINT, a seven-layer integrity decomposition over Physical state, Sensors, Data, Compute, Actuators, Environment, and Time, paired with FRIESA-K, a residual-risk functional that maps each failure path to a quantified risk instance. FRIESA-K grounds the resistance term K in a controlled absorbing Markov model so that control effectiveness is derived from state dynamics rather than assigned as an informal score. The result is a concise mechanism-to magnitude pipeline for resilient agentic and embodied AI. We report governance observability through a separate additive penalty instead of inserting governance as a new variable in the resistance functional. We formalize structural composability linking valid failure paths to well-defined risk instances and show the framework on two contrasting scenarios a hard real-time warehouse robot and a governance-instrumented financial-services agent. Across both cases, the same layer grammar, variable semantics, and dynamic-resistance construction remain intact. Thus, we obtain a compact kernel that supports cross-domain reasoning, explicit assumptions, and quantitatively grounded formalism of composable trust.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。