arXiv:2605.08717cs.SEcs.AI2026-05被引 3

让工程智能体自动诊断失败并生成可执行的修复方案。

Debugging the Debuggers: Failure-Anchored Structured Recovery for Software Engineering Agents

论文配图:Debugging the Debuggers: Failure-Anchored Structured Recovery for Software Engineering Agents
图 1 · 摘自论文原文
  • 以失败为锚点,将运行日志转化为结构化诊断与可操作指导。
  • 在257个未解决案例中实现65.37%诊断准确率和21.79%修复率。
  • 适用于企业级故障恢复、代码修复等场景,无需改动现有系统。

软件工程智能体在可评估环境中部署日益增多,但失败后的恢复仍成本高、依赖人工且随意。现有系统仅暴露日志或生成反馈,未能将异构运行证据转化为有依据、有限界的恢复指导。本文提出PROBE框架,通过遥测层、诊断层与引导门三部分,将失败运行的细粒度信号组织为结构化证据、诊断结果和边界明确的修复建议。遥测层保留精细运行信号,诊断层融合跨信号证据生成有根据的诊断,引导门仅在诊断具备证据支撑、可执行且在代理行为范围内时输出建议。在代码修复、企业工作流恢复和AIOps服务缓解三个场景中评估,针对257个初始未解决案例,PROBE实现65.37%的Top-1诊断准确率和21.79%的恢复率,优于最强非PROBE基线43.58和12.45个百分点。结果揭示诊断-恢复鸿沟:准确诊断必要但不足,须转化为可执行、可验证的边界指导。在微软IcM原型中,PROBE可作为无侵入侧通道集成至现有诊断流程,不改变代理策略、工具集或执行预算。表明基于遥测证据的失败锚定恢复能在真实工程约束下提升事后恢复能力。

原文摘要 · Abstract (English)

Software engineering agents are increasingly deployed in evaluable engineering environments, yet post-failure recovery remains costly, manual, and ad hoc. Existing systems expose traces or generate follow-up feedback, but they do not convert heterogeneous runtime evidence into grounded, bounded recovery guidance for a subsequent attempt. We present PROBE, a failure-anchored framework for structured recovery in software engineering agents. PROBE organizes failed-run telemetry into structured evidence, structured diagnosis, and bounded recovery guidance through a Telemetry Layer, a Diagnosis Layer, and a Guidance Gate. The Telemetry Layer preserves fine-grained runtime signals, the Diagnosis Layer fuses cross-signal evidence into grounded diagnoses, and the Guidance Gate produces diagnosis-derived guidance only when it is evidence-grounded, actionable, and within the scope of agent-side behavior. We evaluate PROBE across three settings: repository-level software repair, enterprise workflow recovery, and AIOps service mitigation. On 257 initially unresolved cases, PROBE achieves 65.37% Top-1 diagnosis accuracy and a 21.79% recovery rate, outperforming the strongest non-PROBE baseline by 43.58 and 12.45 percentage points. The results reveal a diagnosis-recovery gap: accurate diagnosis is necessary but insufficient unless translated into bounded guidance that a subsequent attempt can execute and verify. Beyond controlled evaluation, a Microsoft IcM prototype shows that PROBE can attach as a non-intrusive side channel to existing service-diagnosis workflows without changing the agent policy, toolset, or execution budget. These results suggest that telemetry-grounded, failure-anchored recovery can improve post-failure recoverability under realistic engineering constraints.

智能体故障恢复代码修复AIOps

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。