arXiv:2511.10949cs.MAcs.AI2025-11被引 8

揭示多智能体系统在对抗性指令下的安全弱点。

Exposing Weak Links in Multi-Agent Systems under Adversarial Prompting

  • 构建统一框架SafeAgents,细粒度评估多智能体系统安全
  • 发现集中式系统因任务拆分导致隐蔽攻击,鲁棒性下降
  • 提出Dharma诊断工具,定位多智能体流程中的脆弱环节

基于大语言模型的智能体正被广泛部署于多智能体系统(MAS)。随着其向真实场景应用发展,安全性日益重要。现有研究主要聚焦单智能体安全,缺乏对多智能体设计引入漏洞的系统性评估。现有方法因缺乏统一框架与针对多智能体特有拒绝模式的度量而不足。本文提出SafeAgents——一个统一且可扩展的多智能体系统安全评估框架。该框架系统揭示了计划构建策略、智能体间上下文共享及容错行为等设计选择如何影响对抗性指令下的脆弱性。我们引入Dharma诊断指标,用于识别多智能体流水线中的薄弱环节。通过SafeAgents,在四个数据集(涵盖网页任务、工具使用和代码生成)上对五种主流多智能体架构(集中式、分布式及混合变体)进行综合研究。结果表明,常见设计模式存在显著漏洞:例如,仅向子智能体分配原子指令的集中式系统会隐藏有害目标,降低系统鲁棒性。研究强调多智能体系统需采用安全优先的设计范式。代码链接:https://github.com/microsoft/SafeAgents

原文摘要 · Abstract (English)

LLM-based agents are increasingly deployed in multi-agent systems (MAS). As these systems move toward real-world applications, their security becomes paramount. Existing research largely evaluates single-agent security, leaving a critical gap in understanding the vulnerabilities introduced by multi-agent design. However, existing systems fall short due to lack of unified frameworks and metrics focusing on unique rejection modes in MAS. We present SafeAgents, a unified and extensible framework for fine-grained security assessment of MAS. SafeAgents systematically exposes how design choices such as plan construction strategies, inter-agent context sharing, and fallback behaviors affect susceptibility to adversarial prompting. We introduce Dharma, a diagnostic measure that helps identify weak links within multi-agent pipelines. Using SafeAgents, we conduct a comprehensive study across five widely adopted multi-agent architectures (centralized, decentralized, and hybrid variants) on four datasets spanning web tasks, tool use, and code generation. Our findings reveal that common design patterns carry significant vulnerabilities. For example, centralized systems that delegate only atomic instructions to sub-agents obscure harmful objectives, reducing robustness. Our results highlight the need for security-aware design in MAS. Link to code is https://github.com/microsoft/SafeAgents

多智能体安全评估对抗性攻击LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。