提出去中心化协作机制,让多个大模型更安全高效选出最优答案
Byzantine-Robust Decentralized Coordination of LLM Agents
- 多代理并行生成答案,评估者独立打分排序选优
- 在存在恶意代理时仍能快速达成共识,答案质量提升显著
- 适合高安全性需求的分布式智能系统,如区块链应用
多个大语言模型(LLM)代理协同是克服单代理系统局限性的有效途径,如幻觉和单点故障。随着LLM代理越来越多部署在开放区块链平台,能够容忍恶意(拜占庭)代理的多代理系统变得至关重要。现有拜占庭容错多代理系统通常依赖领导节点协调,存在两大缺陷:一是领导节点易遭针对性攻击,连续恶意领导会导致反复失败,引发新共识轮次,而LLM调用延迟高,成本巨大;二是即使存在更优方案,只要领导提案获得多数票即被采纳。为此,我们提出DecentLLMs,一种新型去中心化共识方法,其中工作代理并行生成答案,评估代理独立评分与排序,以选出最佳可用答案。该去中心化架构在存在拜占庭代理的情况下仍可实现快速共识,并通过拜占庭鲁棒聚合技术持续选择高质量答案。实验表明,DecentLLMs能有效容忍拜占庭代理,显著提升所选答案质量。
原文摘要 · Abstract (English)
Collaboration among multiple large language model (LLM) agents is a promising approach to overcome inherent limitations of single-agent systems, such as hallucinations and single points of failure. As LLM agents are increasingly deployed on open blockchain platforms, multi-agent systems capable of tolerating malicious (Byzantine) agents have become essential. Recent Byzantine-robust multi-agent systems typically rely on leader-driven coordination, which suffers from two major drawbacks. First, they are inherently vulnerable to targeted attacks against the leader. If consecutive leaders behave maliciously, the system repeatedly fails to achieve consensus, forcing new consensus rounds, which is particularly costly given the high latency of LLM invocations. Second, an underperforming proposal from the leader can be accepted as the final answer even when higher-quality alternatives are available, as existing methods finalize the leader's proposal once it receives a quorum of votes. To address these issues, we propose DecentLLMs, a novel decentralized consensus approach for multi-agent LLM systems, where worker agents generate answers concurrently and evaluator agents independently score and rank these answers to select the best available one. This decentralized architecture enables faster consensus despite the presence of Byzantine agents and consistently selects higher-quality answers through Byzantine-robust aggregation techniques. Experimental results demonstrate that DecentLLMs effectively tolerates Byzantine agents and significantly improves the quality of selected answers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。