无需训练即可提升大模型多智能体系统效率,通过共识与信心动态组队。
CONCAT: Consensus- and Confidence-Driven Ad Hoc Teaming for Efficient LLM-Based Multi-Agent Systems

- 基于初始回答和信心度聚类智能体,选出各簇领导者。
- 用心智理论设计启发函数预测领导间协作收益,优化通信路径。
- 在不训练的前提下,降低50.1%延迟,效率提升2.02倍,适合通用场景。
基于大语言模型(LLM)的多智能体系统虽能解决复杂任务并超越单智能体表现,但因智能体间频繁通信导致巨大计算开销。现有研究通过训练稀疏多智能体图或微调规划器来优化流程,但引入额外计算成本且限制于特定领域,损害泛化能力。本文提出CONCAT框架,一种无需训练的协同机制,基于共识与信心实现即兴组队。具体而言,根据智能体初始答案进行聚类,依据其信心度选取各簇领导者;设计基于心智理论的启发函数,根据答案与信心预测任意两领导者间的协作收益;最终通过剔除部分通信构建即兴多智能体网络。在三个LLM与三个基准测试上的实验表明,CONCAT相较LLM-Debate效率提升最高达2.02倍,优于训练感知方法如AgentDropout,同时在Qwen2.5-14B-Instruct上平均延迟降低50.1%,且无需任何任务特异性训练。
原文摘要 · Abstract (English)
Although large language model (LLM) based multi-agent systems (MAS) show their capability to solve complex tasks and achieve higher performance over single agent systems, they lead to huge computational overheads because of heavy communication between agents. Previous research has made efforts to train a sparse multi-agent graph or fine-tune a planner to orchestrate the workflow better. However, such extra training processes introduce computational costs and limit MAS to specific domains, therefore compromising their generalizability. In this paper, we propose CONCAT, a training-free multi-agent collaboration framework based on CONsensus and Confidence-driven Ad hoc Teaming to efficiently organize agent interactions. Specifically, agents are clustered based on their initial answers, and leaders of each cluster are selected based on the agents' confidence. Then, a heuristic function based on the Theory of Mind is designed to predict the collaboration benefits between every two leaders according to their answers and confidence. Finally, an ad hoc multi-agent network is organized after evicting a percentage of communications based on the predicted benefits. Experiments across three LLMs and three benchmarks show that CONCAT achieves up to 2.02x higher efficiency (accuracy/latency ratio) than LLM-Debate and outperforms training-aware methods such as AgentDropout, while reducing average latency by 50.1% on Qwen2.5-14B-Instruct, without any task-specific training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。