用动态图结构自动定位多智能体系统故障根源。
Adaptive Influence Graphs for Failure Attribution in Multi-Agent Systems
- 将失败日志转为可交互的动态影响图,分两阶段定位错误
- 在Who&When基准上超越现有方法,准确率显著提升
- 适合需要快速诊断复杂系统故障的研发团队
多智能体大模型系统在现实应用中日益普及,其故障成本高且难定位。尽管自动化故障归因研究不断推进,但实际调试仍依赖工程师人工排查。工程师通常不会逐行阅读原始日志,而是借助可观测性工具按组件、动作和依赖关系组织追踪信息以实现定向导航。我们假设现代大模型也可从中受益。为此,提出自适应影响图(AIGs),一种两阶段代理框架:首先将失败轨迹转化为结构化图,再通过代理驱动的遍历定位关键错误。在多个模型上验证,更丰富的轨迹表征能持续提升归因效果,其中自适应图构建与代理引导遍历表现最佳。AIGs在标准多智能体故障归因基准Who&When上达到新最优水平,证实了归因效果不仅取决于诊断模型本身,还与轨迹的表征方式和探索策略密切相关。
原文摘要 · Abstract (English)
Multi-agent LLM systems are increasingly deployed in real-world applications, where failures can be costly and difficult to localize. Despite growing efforts to automate failure attribution, diagnosing failed runs still largely relies on human engineers. Yet engineers rarely debug complex systems by reading raw logs end to end. Instead, observability tools organize traces around components, actions, and dependencies to support targeted navigation. We hypothesize that modern LLMs can benefit from the same paradigm. To test this hypothesis, we introduce Adaptive Influence Graphs (AIGs), a two-stage agentic framework that first transforms a failed trace into a structured graph and then navigates it to identify the critical error. Across multiple models, we show that richer trace representations consistently improve failure attribution, with adaptive graph construction and agent-directed traversal yielding the strongest results. AIGs establish a new state of the art on Who&When, the standard benchmark for multi-agent failure attribution. This affirms our hypothesis that attribution depends not only on the diagnosing model, but also on how the trace is represented and explored.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。