arXiv:2510.15739cs.AIcs.MA2025-10被引 4

AURA框架可量化评估自主AI代理风险,助力企业安全部署。

AURA: An Agent Autonomy Risk Assessment Framework

  • 基于伽马分布设计风险评分机制,兼顾准确与效率。
  • 支持人机协同监督,实现自主代理的实时风险评估。
  • 适合关注AI治理与风险管控的企业级应用开发者。

随着自主智能体在组织中的广泛应用,对齐、治理和风险管理等持续性挑战正阻碍其规模化部署。本文提出AURA(Agent Autonomy Risk Assessment)框架,用于检测、量化并缓解自主智能体带来的风险。该框架结合最新研究成果与实际部署经验,引入基于伽马分布的风险评分方法,在保证评估准确性的同时兼顾计算效率与实际可行性。AURA提供交互式流程,可同步或异步(自主地)评估单个或多个智能体的风险,并支持人机协同(HITL)监管。框架内置代理到人类(A2H)通信机制,可无缝集成至智能体系统中实现自主评估,兼容现有协议(如MCP和A2A)。AURA有助于推动自主智能体负责任且透明的落地,兼顾计算资源约束,是企业级大规模可控智能体系统的关键支撑。

原文摘要 · Abstract (English)

As autonomous agentic AI systems see increasing adoption across organisations, persistent challenges in alignment, governance, and risk management threaten to impede deployment at scale. We present AURA (Agent aUtonomy Risk Assessment), a unified framework designed to detect, quantify, and mitigate risks arising from agentic AI. Building on recent research and practical deployments, AURA introduces a gamma-based risk scoring methodology that balances risk assessment accuracy with computational efficiency and practical considerations. AURA provides an interactive process to score, evaluate and mitigate the risks of running one or multiple AI Agents, synchronously or asynchronously (autonomously). The framework is engineered for Human-in-the-Loop (HITL) oversight and presents Agent-to-Human (A2H) communication mechanisms, allowing for seamless integration with agentic systems for autonomous self-assessment, rendering it interoperable with established protocols (MCP and A2A) and tools. AURA supports a responsible and transparent adoption of agentic AI and provides robust risk detection and mitigation while balancing computational resources, positioning it as a critical enabler for large-scale, governable agentic AI in enterprise environments.

AI治理风险评估自主智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。