arXiv:2607.18754cs.AIcs.CL2026-07被引 3

开源工具AgentDebugX让大模型智能体故障可定位、可修复,提升调试闭环效率。

AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents

论文配图:AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents
图 1 · 摘自论文原文
  • 构建检测-归因-恢复-重试闭环,通过全局轨迹分析定位错误根源。
  • 在qwen3.5-9b上实现28.8%的精准归因准确率,修复任务数超基线三倍。
  • 支持多端接入与故障经验共享,适合开发和运维大模型应用的团队使用。

大模型智能体故障难以调试,因为错误表现的步骤常非根本原因所在。现有可观测性工具虽可回放执行轨迹,但对根因定位和诊断转修复支持有限。我们提出AgentDebugX,一个开源调试框架,将调试过程组织为检测、归因、恢复、重试的闭环。核心组件DeepDebug通过全局轨迹理解、结构引导调查和交叉验证实现多轮根因诊断。在Who and When基准测试中,DeepDebug在两种开放权重主干模型上均取得最优严格归因准确率,于qwen3.5-9b上达到28.8%的精确智能体与步骤准确率,优于最强单次遍历基线的21.7%。在GAIA基准上,DeepDebug单次重试修复13/73个失败任务,较三个解耦自修正基线(4-6个)显著提升,整体准确率从55.8%提升至63.6%。AgentDebugX通过Python库、命令行、网页控制台及可安装的智能体技能暴露该工作流,并提供可选的错误枢纽(Error Hub),用于共享清洗后的故障诊断修复包,复用为调试记忆。

原文摘要 · Abstract (English)

LLM agent failures are difficult to debug because the step where an error surfaces is often not the one that caused it. Existing observability tools replay execution traces but provide little support for identifying the root cause or translating diagnosis into recovery. We present AgentDebugX, an open-source debugging framework that organizes debugging as a closed loop of Detect, Attribute, Recover, and Rerun. At its core, DeepDebug performs multi-turn root-cause diagnosis through global trajectory understanding, structure-guided investigation, and cross-examination. On the Who and When benchmark, DeepDebug achieves the best strict attribution accuracy among the evaluated methods on both tested open-weight backbones, reaching 28.8 percent exact agent-and-step accuracy on qwen3.5-9b versus 21.7 percent for the strongest single-pass baseline. On GAIA, DeepDebug repairs 13 of 73 failed tasks in a single rerun, compared with 4 to 6 for three decoupled self-correction baselines, improving overall accuracy from 55.8 percent to 63.6 percent. AgentDebugX exposes this workflow through a Python library, CLI, web console, and installable agentic skill, and provides an opt-in Error Hub for sharing scrubbed failure-diagnosis-repair bundles and reusing them as debugging memory.

智能体调试大模型故障修复开源工具

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。