arXiv:2510.00685cs.MAcs.CL2025-10中稿 · ICLR被引 4

让多个大模型自动组织协作,动态调整沟通方式。

Stochastic Self-Organization in Multi-Agent Systems

  • 基于响应自适应构建动态有向图,调节信息流动。
  • 弱模型场景下性能显著优于传统方法,错误率大幅降低。
  • 无需额外训练,适合复杂任务中的多智能体系统。

基于大语言模型的多智能体系统(MAS)有望解决单一模型无法完成的任务,但其潜力取决于智能体间协作机制的优化。现有方法多依赖固定拓扑、预训练图生成器或外部评判模型,增加了复杂性。本文提出一种响应条件化的自组织框架——SelfOrg,智能体独立生成响应并用拟合的沙普利值评估同伴贡献,构建有向无环图(DAG)以调控信息传播,确保高贡献者向其他智能体稳定传递结果。该图根据前一轮协作的响应动态更新。由于框架无需额外监督或训练即可实现智能体自组织,故命名为SelfOrg。实验表明,无论强弱模型后端,均表现稳健,在弱模型场景中相较以往方法显著提升性能。理论分析还证明,多智能体可提高正确性概率,且正确响应自然主导信息流。

原文摘要 · Abstract (English)

Multi-agent systems (MAS) based on Large Language Models (LLMs) have the potential to solve tasks that are beyond the reach of any single LLM. However, this potential can only be realized when the collaboration mechanism between agents is optimized. Specifically, optimizing the communication structure between agents is critical for fruitful collaboration. Most existing approaches rely on fixed topologies, pretrained graph generators, optimization over edges, or employ external LLM judges, thereby adding to the complexity. In this work, we introduce a response-conditioned framework that adapts communication on-the-fly. Agents independently generate responses to the user query and assess peer contributions using an approximation of the Shapley value. A directed acyclic graph (DAG) is then constructed to regulate the propagation of the responses among agents, which ensures stable and efficient message transmission from high-contributing agents to others. This graph is dynamically updated based on the agent responses from the previous collaboration round. Since the proposed framework enables the self-organization of agents without additional supervision or training, we refer to it as SelfOrg. The SelfOrg framework goes beyond task- and query-level optimization and takes into account the stochastic nature of agent responses. Experiments with both strong and weak LLM backends demonstrate robust performance, with significant gains in the weak regime where prior methods collapse. We also theoretically show that multiple agents increase the chance of correctness and that the correct responses naturally dominate the information flow.

多智能体自组织大模型协作动态图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。