用可审计的指标评估AI代理真实上线能力,避免盲目部署。
Stop Shipping AI Agents on Faith: Capability Is Not Production Readiness

- 构建四维评估体系:评估、上下文、合规、治理,量化上线准备度。
- 实测显示环境设计显著影响可靠性,治理信息不可隐藏。
- 适合金融医疗等高监管领域,帮助团队从凭感觉发布转向证据决策。
AI代理正进入生产流程,承担信息检索、调用工具、状态维护及代行操作等任务,但当前发布决策仍依赖能力信号、演示或行为测试,这些无法反映其在生产约束下的实际就绪状态。能力不等于生产就绪。本文提出证明代理指数(PAI),一个用于评估AI代理治理就绪度的指标体系,涵盖评估、上下文、合规与治理四个维度:评估衡量实际行为表现,上下文衡量影响行为的运行环境,合规衡量是否符合规则与控制要求,治理衡量组织是否具备授权、监控、审计和控制代理的能力。PAI通过开源的ProofAgent Harness实现,支持可审计的代理评估与治理。在医疗与金融两个高度监管领域验证表明,PAI能有效预测未见配置的就绪状态,并区分高低风险配置。结果表明:上下文工程显著影响可靠性,能力提升改善行为但不决定就绪,治理证据必须持续可见而非被平均。PAI将代理发布从基于信任的决策转变为可审计的就绪决策。
原文摘要 · Abstract (English)
AI agents are moving into production workflows where they retrieve information, call tools, maintain state, and act on behalf of users or organizations, but many release decisions still rely on capability signals, demos, or behavioral tests that do not show whether an agent is ready to operate under production constraints. Capability is therefore not production readiness. This paper introduces the ProofAgent Index (PAI), a governance readiness index for AI agents. PAI combines four dimensions of deployment evidence: Evaluation, Context, Compliance, and Governance. Evaluation measures observed behavior, Context measures the operating environment that shapes that behavior, Compliance measures alignment with applicable rules and controls, and Governance measures whether the organization can authorize, monitor, audit, and control the agent during operation. PAI is implemented inside ProofAgent Harness, an open source infrastructure for auditable AI agent evaluation and governance. Validation across two heavily regulated domains, healthcare and finance, shows that PAI carries held out readiness signal and separates higher risk from lower risk configurations. The results show that context engineering strongly changes reliability, capability improves behavior but does not determine readiness, and governance evidence must remain visible rather than averaged away. PAI reframes agent release from a faith based deployment decision into an auditable readiness decision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。