arXiv:2602.19843cs.SEcs.AI2026-02被引 8

为大模型多智能体系统设计故障注入框架,揭示其可靠性弱点。

MAS-FIRE: Fault Injection and Reliability Evaluation for LLM-Based Multi-Agent Systems

  • 定义15类故障并用三种无侵入方式注入
  • 发现闭环架构可避免40%以上灾难性故障
  • 提供逐层诊断方法,适合系统开发者

随着基于大语言模型的多智能体系统(MAS)被广泛用于复杂任务,其可靠性成为迫切挑战。由于智能体通过非结构化自然语言协作而非固定协议,易发生语义错误(如幻觉、指令误读、推理漂移),且这些错误无声传播,不触发运行时异常。现有评估方法仅关注最终任务成功率,难以揭示故障成因或恢复能力。为此,我们提出MAS-FIRE,一个系统化的故障注入与可靠性评估框架。定义涵盖智能体内认知错误和跨智能体协调失败的15类故障,通过提示修改、响应重写和消息路由操控三种非侵入机制注入。在三个典型MAS架构上应用,发现丰富的容错行为,并归纳为机制、规则、提示和推理四层。该分层视角实现故障的精细定位。研究发现更强的基础模型并不一定提升鲁棒性,而架构拓扑同样关键:迭代闭环设计可中和线性流程中40%以上导致系统崩溃的故障。MAS-FIRE提供了过程级可观测性与可操作指导,助力系统性提升多智能体系统可靠性。

原文摘要 · Abstract (English)

As LLM-based Multi-Agent Systems (MAS) are increasingly deployed for complex tasks, ensuring their reliability has become a pressing challenge. Since MAS coordinate through unstructured natural language rather than rigid protocols, they are prone to semantic failures (e.g., hallucinations, misinterpreted instructions, and reasoning drift) that propagate silently without raising runtime exceptions. Prevailing evaluation approaches, which measure only end-to-end task success, offer limited insight into how these failures arise or how effectively agents recover from them. To bridge this gap, we propose MAS-FIRE, a systematic framework for fault injection and reliability evaluation of MAS. We define a taxonomy of 15 fault types covering intra-agent cognitive errors and inter-agent coordination failures, and inject them via three non-invasive mechanisms: prompt modification, response rewriting, and message routing manipulation. Applying MAS-FIRE to three representative MAS architectures, we uncover a rich set of fault-tolerant behaviors that we organize into four tiers: mechanism, rule, prompt, and reasoning. This tiered view enables fine-grained diagnosis of where and why systems succeed or fail. Our findings reveal that stronger foundation models do not uniformly improve robustness. We further show that architectural topology plays an equally decisive role, with iterative, closed-loop designs neutralizing over 40% of faults that cause catastrophic collapse in linear workflows. MAS-FIRE provides the process-level observability and actionable guidance needed to systematically improve multi-agent systems.

多智能体可靠性故障注入LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。