从拓扑结构出发,揭示多智能体网络的安全规律。
NetSafe: Exploring the Topological Safety of Multi-agent Networks
- 提出NetSafe框架与迭代RelCom交互机制,统一多智能体系统
- 发现星型拓扑下任务性能下降29.7%,连接越密越易受攻击
- 静态度量比传统图论指标更贴近实际安全表现,适合研究者参考
大型语言模型(LLMs)赋予多智能体网络中的节点智能,推动其在学术与工业领域广泛应用。然而,如何防范网络生成恶意信息仍缺乏研究,且单个LLM的安全性难以迁移。本文从拓扑角度探究多智能体网络的安全性,识别出影响安全性的关键拓扑特性。我们提出通用框架NetSafe及迭代RelCom交互机制,统一现有基于LLM的智能体系统,为广义拓扑安全研究奠定基础。在遭受虚假信息、偏见与有害内容攻击时,我们观察到“代理幻觉”与“聚合安全性”等关键现象。研究发现,高度连通的网络更易受对抗攻击影响,星型拓扑下的任务性能下降29.7%。此外,我们提出的静态度量指标比传统图论指标更贴近真实动态评估结果,表明网络中节点与攻击源平均距离越大,安全性越高。本工作首次引入多智能体网络的拓扑安全视角,揭示若干未被报道的现象,为未来研究提供新方向。
原文摘要 · Abstract (English)
Large language models (LLMs) have empowered nodes within multi-agent networks with intelligence, showing growing applications in both academia and industry. However, how to prevent these networks from generating malicious information remains unexplored with previous research on single LLM's safety be challenging to transfer. In this paper, we focus on the safety of multi-agent networks from a topological perspective, investigating which topological properties contribute to safer networks. To this end, we propose a general framework, NetSafe along with an iterative RelCom interaction to unify existing diverse LLM-based agent frameworks, laying the foundation for generalized topological safety research. We identify several critical phenomena when multi-agent networks are exposed to attacks involving misinformation, bias, and harmful information, termed as Agent Hallucination and Aggregation Safety. Furthermore, we find that highly connected networks are more susceptible to the spread of adversarial attacks, with task performance in a Star Graph Topology decreasing by 29.7%. Besides, our proposed static metrics aligned more closely with real-world dynamic evaluations than traditional graph-theoretic metrics, indicating that networks with greater average distances from attackers exhibit enhanced safety. In conclusion, our work introduces a new topological perspective on the safety of LLM-based multi-agent networks and discovers several unreported phenomena, paving the way for future research to explore the safety of such networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。