让多个AI代理先并行工作,再根据结果决定是否串行沟通,兼顾效率与准确
Response-Conditioned Parallel-to-Sequential Orchestration for Multi-Agent Systems
- 先并行处理,再用轻量Transformer判断是否需要串行沟通
- 在不依赖外部评分模型的情况下,实现95%以上的任务准确率
- 政策可跨任务、跨代理数量复用,适合多智能体协作场景
多智能体系统可通过多个大语言模型代理的协作解决复杂任务。现有协作框架通常采用并行或串行模式:并行模式下代理独立响应后聚合结果;串行模式则通过有向拓扑逐步交互优化。但两者均难以在降低通信与延迟的同时保证最终响应的准确性。本文提出混合范式Nexa,一种可训练的响应条件化策略,融合两种模式优势。Nexa首先并行执行,将结果嵌入共享语义空间,并预测一个稀疏有向无环通信图。若图为空,则保持纯并行;若非空,则进行一次串行消息传播。该策略采用轻量Transformer模型,无需外部LLM评判器或奖励模型,也无需人工设计测试时拓扑搜索。我们形式化了该混合执行问题,证明所生成图天然为无环结构,且框架严格包含纯并行执行。实验表明,Nexa在一种设置下学习到的通信策略可泛化至不同代理数量、任务及底层代理,凸显其政策的通用性。
原文摘要 · Abstract (English)
Multi-agent systems can solve complex tasks through collaboration between multiple Large Language Model agents. Existing collaboration frameworks typically operate in either a parallel or a sequential mode. In the parallel mode, agents respond independently to queries followed by aggregation of responses. In contrast, sequential systems allow agents to communicate via a directed topology and refine one another step by step. However, both modes are inadequate for achieving the desired objectives of minimizing communication and latency while simultaneously maximizing the accuracy of the final response. In this work, we introduce a hybrid paradigm called Nexa, a trainable response-conditioned policy that bridges the gap between the two modes. Nexa begins with a parallel execution stage, embeds the resulting responses into a shared semantic space, and then predicts a sparse directed acyclic communication graph. If the graph is empty, the system remains purely parallel; if it is non-empty, the system performs one sequential message propagation. The policy is a lightweight transformer model, and the method avoids the need for external LLM judges or reward models, as well as hand-crafted test-time topology search. We formalize this hybrid execution problem, show that the resulting graph is acyclic by construction, and that the framework strictly subsumes pure parallel execution, and present a training procedure based on policy-gradient optimization. Results demonstrate that the response-conditioned policy learned by Nexa under one setting can be reused when the number of agents, the task, or the underlying agent changes, thus emphasizing the generalizability of the learned communication policy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。