为自主AI代理设计可查询的推理溯源系统,提升行为分析能力。
Reasoning Provenance for Autonomous AI Agents: Structured Behavioral Analytics Beyond State Checkpoints and Execution Traces
- 提出结构化推理溯源记录AER,记录每步决策的原因与证据链。
- 支持群体级行为分析,如推理模式挖掘与置信度校准。
- 适合需要可解释性与审计能力的生产级AI系统开发者。
随着AI代理从人工协作者转向自主平台基础设施,对多任务中推理行为进行分析成为关键基础设施需求。现有工具虽能实现状态快照、执行追踪与遥测互通,但缺乏以结构化方式记录推理过程的原生能力。本文提出代理执行记录(AER),作为第一类可查询的推理溯源机制,包含意图、观察、推断等字段,以及版本化计划、证据链、带置信度的结构化结论和委托权限链。我们区分了计算状态持久化与推理溯源的本质差异,证明后者无法由前者重建,并展示了通过AER实现群体级行为分析的能力:推理模式挖掘、置信度校准、跨代理对比及基于模拟回放的反事实测试。本文提供领域无关模型、可扩展领域配置、参考实现与SDK,评估方法基于在生产级根因分析代理上的初步部署。
原文摘要 · Abstract (English)
As AI agents transition from human-supervised copilots to autonomous platform infrastructure, the ability to analyze their reasoning behavior across populations of investigations becomes a pressing infrastructure requirement. Existing operational tooling addresses adjacent needs effectively: state checkpoint systems enable fault tolerance; observability platforms provide execution traces for debugging; telemetry standards ensure interoperability. What current systems do not natively provide as a first-class, schema-level primitive is structured reasoning provenance -- normalized, queryable records of why the agent chose each action, what it concluded from each observation, how each conclusion shaped its strategy, and which evidence supports its final verdict. This paper introduces the Agent Execution Record (AER), a structured reasoning provenance primitive that captures intent, observation, and inference as first-class queryable fields on every step, alongside versioned plans with revision rationale, evidence chains, structured verdicts with confidence scores, and delegation authority chains. We formalize the distinction between computational state persistence and reasoning provenance, argue that the latter cannot in general be faithfully reconstructed from the former, and show how AERs enable population-level behavioral analytics: reasoning pattern mining, confidence calibration, cross-agent comparison, and counterfactual regression testing via mock replay. We present a domain-agnostic model with extensible domain profiles, a reference implementation and SDK, and outline an evaluation methodology informed by preliminary deployment on a production platformized root cause analysis agent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。