用轻量通信框架降低大模型多智能体系统成本,省75%费用还更安全
Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems
- 提出新通信框架AgentPrune,一键剪枝冗余消息
- 六项测试中成本仅5.6美元,比主流方案低75%
- 能防御两类攻击,性能还提升3.5%~10.8%
基于大语言模型的多智能体系统虽展现集体智能优势,但现有通信管道存在大量冗余消息,导致令牌开销与经济成本高昂。为此,本文提出经济高效的多智能体通信框架AgentPrune,首次形式化定义了通信冗余问题,并在时空消息传递图上实现单次剪枝,构建出低耗高能的通信拓扑。在六个基准测试中,AgentPrune以仅$5.6的成本达成与顶尖拓扑相当的性能,相较其$43.7的成本大幅降低;可无缝集成至主流系统,令牌消耗减少28.1%~72.8%;并有效防御两种基于智能体的对抗攻击,性能提升3.5%~10.8%。
原文摘要 · Abstract (English)
Recent advancements in large language model (LLM)-powered agents have shown that collective intelligence can significantly outperform individual capabilities, largely attributed to the meticulously designed inter-agent communication topologies. Though impressive in performance, existing multi-agent pipelines inherently introduce substantial token overhead, as well as increased economic costs, which pose challenges for their large-scale deployments. In response to this challenge, we propose an economical, simple, and robust multi-agent communication framework, termed $\texttt{AgentPrune}$, which can seamlessly integrate into mainstream multi-agent systems and prunes redundant or even malicious communication messages. Technically, $\texttt{AgentPrune}$ is the first to identify and formally define the \textit{communication redundancy} issue present in current LLM-based multi-agent pipelines, and efficiently performs one-shot pruning on the spatial-temporal message-passing graph, yielding a token-economic and high-performing communication topology. Extensive experiments across six benchmarks demonstrate that $\texttt{AgentPrune}$ \textbf{(I)} achieves comparable results as state-of-the-art topologies at merely $\$5.6$ cost compared to their $\$43.7$, \textbf{(II)} integrates seamlessly into existing multi-agent frameworks with $28.1\%\sim72.8\%\downarrow$ token reduction, and \textbf{(III)} successfully defend against two types of agent-based adversarial attacks with $3.5\%\sim10.8\%\uparrow$ performance boost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。