让大模型代理的每一步操作都可追溯,提升可信度与可审计性。
From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agents

- 构建执行溯源图与证据追踪关系,统一管理行为链条。
- 支持工具调用、记忆影响、错误定位等关键环节的可解释性。
- 适合关注AI安全、审计与故障排查的研究者与开发者。
基于大语言模型(LLM)的智能体正从被动文本生成演变为具备规划、工具使用、检索、记忆访问及多智能体协作能力的自主系统。这些能力虽增强了自主性,但也使行为难以验证、调试与审计。仅凭最终答案准确率无法揭示输出生成过程、各主张的依据、工具调用是否合理、记忆如何影响后续决策或失败根源。本文综述证据追踪与执行溯源,作为构建可信智能体过程级问责的基础。定义执行溯源为智能体执行的带类型图结构,证据追踪为其在证据支持关系上的投影。该视角将检索归因、主张支撑、工具使用安全、记忆溯源、可观测性、调试、审计与恢复整合于统一框架。提出涵盖追踪来源、证据与执行单元、溯源关系、追踪粒度与时机、表示形式及信任功能的分类体系。回顾关键方法方向:溯源表示、证据归属、工具使用溯源、运行时防护机制、承载溯源的记忆、可观测性与故障诊断。最后讨论基准、数据集、评估指标及构建可溯源、可审计、可恢复智能体系统的开放挑战。
原文摘要 · Abstract (English)
Large language model (LLM)-based agents are evolving from passive text generators into autonomous systems capable of planning, tool use, retrieval, memory access, environmental interaction, and multi-agent collaboration. These capabilities expand agent autonomy, but also make agent behavior harder to verify, debug, and audit. Final-answer accuracy alone cannot explain how an output was produced, which evidence supported each claim, whether tool calls were justified, how memory influenced later decisions, or where failures originated. This survey examines evidence tracing and execution provenance as foundations for process-level accountability in trustworthy LLM agents. We define execution provenance as the typed graph of an agent execution and evidence tracing as its projection onto evidence-support relations. This perspective connects retrieval grounding, claim support, tool-use safety, memory lineage, observability, debugging, audit, and recovery within a unified framework. We introduce a taxonomy covering trace sources, evidence and execution units, provenance relations, tracing granularity and timing, representation forms, and trust functions. We then review key methodological directions, including provenance representation, evidence attribution, tool-use provenance, runtime guardrails, provenance-bearing memory, observability, and failure diagnosis. Finally, we discuss benchmarks, datasets, metrics, and open challenges for building provenance-aware, auditable, and recoverable agent systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。