让大模型代理像神经网络一样自动协作,通过强化学习实现高效分工。
NeuroMAS: Multi-Agent Systems as Neural Networks with Joint Reinforcement Learning

- 将多代理系统建模为可训练的神经网络架构,节点为语言代理,边为文本信号流。
- 在复杂任务上优于传统设计与训练好的基线,且系统规模扩展依赖渐进式成长路径。
- 适合研究大模型协同、自动化系统设计及可扩展智能体架构的学者。
多代理语言系统通常采用人工设计的工作流,代理被赋予特定语义角色,通信协议预先定义。本文提出NeuroMAS,将多代理语言系统视为可训练且可扩展的类神经网络架构:大语言模型代理作为节点,中间文本信号作为边。代理节点无固定角色但具备结构感知能力,拓扑仅决定信息流动的一般方式,而强化学习训练则决定节点间的通信、专业化与协调机制。该范式将多代理系统设计从工作流工程转向架构设计,深度、宽度、连接性与生长协议成为可扩展的能力来源。进一步地,我们从理论角度证明,当任务具有层次分解特性时,这种模块化文本计算更具参数效率。实验表明,NeuroMAS显著优于推理时与训练好的多代理基线。此外发现组织规模扩展具有路径依赖性:从零开始训练大规模系统困难,但若从已训练的小系统逐步增长,则变得可行。这些结果表明,学习型神经多代理系统是大模型的一种有前景的扩展方向。
原文摘要 · Abstract (English)
Multi-agent language systems are often built as hand-designed workflows, where agents are assigned semantic roles and communication protocols are specified in advance. We propose NeuroMAS, a method that first treats a multi-agent language system as a trainable and scalable neural-network-like architecture with LLM agents as nodes and intermediate textual signals as edges. In NeuroMAS, agent nodes are role-free but structure-aware: the topology only determines how information can flow in general, while reinforcement learning training determines how nodes communicate, specialize, and coordinate. This formulation shifts multi-agent design from workflow engineering toward architecture design, where depth, width, connectivity, and growth protocol become scalable sources of capability. Further, we provide a theoretical perspective showing why such modular textual computation is more parameter-efficient when tasks admit hierarchical decompositions. Experiments show that NeuroMAS improves significantly over both inference-time and trained multi-agent baselines. We further find that organizational scaling is path-dependent: larger systems can be challenging to train from scratch, but become feasible when grown progressively from smaller trained systems. These results suggest that learned neural multi-agent systems are a promising scaling axis for LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。