提升大模型多智能体系统的抗扰能力,通过优化通信结构和提示设计增强韧性。
ResMAS: Resilience Optimization in LLM-based Multi-agent Systems
- 分两阶段优化:用强化学习生成抗扰通信拓扑,再根据连接关系优化各智能体提示。
- 在多种任务上显著提升系统韧性,即使在节点失效情况下仍保持稳定性能。
- 方法可迁移至新任务与新模型,适合构建高可靠性的多智能体系统。
基于大语言模型的多智能体系统(LLM-based MAS)在多个领域表现出色,但因分布式部署而易受智能体失效等扰动影响。现有研究多聚焦于攻击发生后的被动防御,缺乏对系统内在韧性的主动设计。本文发现通信拓扑与提示设计均显著影响系统韧性。为此提出ResMAS:一种两阶段框架。首先训练奖励模型预测系统韧性,并通过强化学习生成针对特定任务的抗扰拓扑;其次引入拓扑感知的提示优化方法,根据智能体间的连接与交互动态调整其提示。大量实验表明,该方法在多种任务下显著提升系统韧性,且对新任务和新模型具有强泛化能力,展现出构建鲁棒多智能体系统的潜力。
原文摘要 · Abstract (English)
Large Language Model-based Multi-Agent Systems (LLM-based MAS), where multiple LLM agents collaborate to solve complex tasks, have shown impressive performance in many areas. However, MAS are typically distributed across different devices or environments, making them vulnerable to perturbations such as agent failures. While existing works have studied the adversarial attacks and corresponding defense strategies, they mainly focus on reactively detecting and mitigating attacks after they occur rather than proactively designing inherently resilient systems. In this work, we study the resilience of LLM-based MAS under perturbations and find that both the communication topology and prompt design significantly influence system resilience. Motivated by these findings, we propose ResMAS: a two-stage framework for enhancing MAS resilience. First, we train a reward model to predict the MAS's resilience, based on which we train a topology generator to automatically design resilient topology for specific tasks through reinforcement learning. Second, we introduce a topology-aware prompt optimization method that refines each agent's prompt based on its connections and interactions with other agents. Extensive experiments across a range of tasks show that our approach substantially improves MAS resilience under various constraints. Moreover, our framework demonstrates strong generalization ability to new tasks and models, highlighting its potential for building resilient MASs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。