arXiv:2608.06346cs.AI2026-08被引 1

定位长轨迹中引发最终失败的最早关键错误,提升智能体系统可调试性。

TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories

论文配图:TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories
图 1 · 摘自论文原文
  • 通过多粒度历史压缩和证据驱动方法追踪错误生命周期。
  • 在486条标注失败轨迹上实现优于现有基线的错误定位准确率。
  • 适合研究智能体可靠性、错误诊断与系统优化的开发者与研究员。

基于大模型的智能体系统在复杂任务中表现优异,但面临错误级联和调试困难问题。关键错误检测旨在定位导致最终失败的最早错误步骤。然而,两大挑战限制进展:一是长轨迹中错误证据分散于远距离指令、观测与上下文;二是失败轨迹包含多个局部错误,仅部分对最终失败有决定性影响。本文提出TrajDebug框架,通过多粒度历史压缩与基于证据的错误识别,支持错误生命周期追踪及责任归属分析。我们构建了包含486条人工标注失败轨迹的TrajErrBench基准,覆盖Tau2Bench与SWE-Bench Pro中的真实工具使用与编程场景。跨多种智能体基准的实验表明,TrajDebug在错误定位性能上优于现有方法;应用研究进一步验证其诊断结果能提供可操作反馈以提升下游智能体成功率。代码与数据将公开,推动后续研究。

原文摘要 · Abstract (English)

LLM-based agentic systems have shown remarkable capabilities in complex domains, while suffering from cascading errors and difficulty in debugging. Critical error detection aims to locate the earliest error step in a failed trajectory that is responsible for the final failure. However, progress faces two main challenges. First, long trajectories make it difficult to identify individual errors, since the evidence for judging a step may be scattered across distant instructions, observations, and prior context. Second, failed trajectories often contain multiple local errors with different downstream effects, only some of which remain responsible for the final failure. In this work, we propose TrajDebug, an error-lifecycle tracing framework that addresses long-trajectory error discovery with multi-granularity history compression and evidence-based error identification, and supports critical attribution by tracing each error's resolution status and terminal impact. We further construct TrajErrBench, a benchmark of 486 manually annotated failed trajectories from Tau2Bench and SWE-Bench Pro, covering realistic tool-use and coding scenarios. Experiments across diverse agent benchmarks show that TrajDebug achieves the best overall performance over existing baselines, and application studies further demonstrate that its diagnoses provide actionable feedback for improving downstream agent success. We will release the codes and data to facilitate further research.

智能体错误诊断轨迹分析大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。