用可追溯的经济评估给自动AI风险定价,让自动化变划算且可控。
When Agent Automation Becomes Profitable: Quantifying and Insuring Autonomous AI Risk through Trace-Economic Underwriting

- 基于任务执行轨迹进行风险量化,用确定性经济标签替代大模型判断。
- 实测定价误差从1.77万美元降至569美元,消除不公平补贴。
- 适合关注AI自动化风控、保险与合规的开发者和企业决策者。
AI代理现在能在运营系统中执行不可逆操作,但由代理引发的损失仍无法明确归属、定价或转移。服务商常免责,用户面临无补偿损失,而默认人工审核又限制了自动化效率。本文探讨在存在失败风险下,自主AI部署何时具备经济可行性。答案是:在预期收益超过保费、控制成本及剩余风险时即可接受。这需要明确定义角色权限并使用可比轨迹。我们提出「轨迹-经济承保」机制,将工具使用轨迹映射为用户暴露度与可索赔损失,用于定价、控制与风险转移。该方法采用确定性经济标签,而非依赖LLM评判。在轨迹-损失测试环境中,轨迹-经济定价使平均绝对误差从17.7千美元降至569美元,并消除了累进性交叉补贴。300条轨迹的专家审计中,295条标签保持不变。在1000条真实SWE-smith轨迹上,条件化控制使CVaR95降低72%。定理1给出了有限样本下的适用范围条件。代码、标签与审计表均已开源。
原文摘要 · Abstract (English)
AI agents can now take irreversible actions in operational systems, but agent-caused losses are still not clearly assigned, priced, or transferred. Providers often disclaim consequential damages, users are left with uncompensated losses, and default human review limits the efficiency gains of automation. We ask when autonomous AI deployment can become economically acceptable despite failure risk. Our answer is to quantify risk at the customer-task-trace episode level and transfer it through insurance. Automation is acceptable when its expected benefit exceeds the premium, control cost, and remaining risk. This requires a defined role with bounded permissions and comparable traces. We introduce trace-economic underwriting, which maps tool-use traces to customer exposure and claimable loss, then uses this representation for pricing, control, and risk transfer. It uses deterministic economic labels rather than an LLM judge. In our trace-to-loss testbed, trace-economic pricing reduces pricing MAE from $17.7K to $569 and removes regressive cross-subsidy. A 300-trace expert audit accepts 295 labels unchanged. On 1,000 real SWE-smith traces, trace-conditioned controls reduce CVaR95 by 72%. Theorem~1 gives a finite-sample scope condition. We release code, labels, and audit sheets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。