让多个智能体高效协作,自动决定问谁、问多深、是否沟通。
Route, Communicate, and Reason: Gated Routing and Adaptive Depth for Efficient Multi-Agent Reasoning

- 用四个轻量门控机制自动选择智能体、控制推理深度和通信。
- 在GSM8K等数据集上表现优于所有基线,参数仅一半却高出4.8分。
- 支持运行时更换专家模型,无需重新训练,适合高效率推理场景。
多智能体集成虽然增强性能,却带来参数与计算成本激增,且未解决三个基本问题:应咨询哪些智能体、查询应深入到何种层次、跨智能体通信是否值得开销。本文提出GRADE(门控路由与自适应深度的高效推理系统),通过四个轻量级可学习门控机制,联合控制智能体选择、层级深度、跨智能体通信及分支剪枝。训练采用新型无评判器方法CoGRPO,将梯度相对策略优化适配至多智能体层级结构,为每个参与推理的门控与智能体分配共享优势信号。智能体模型来自可热插拔的专家注册表;每智能体校准映射使推理时替换专家无需重训。平均仅170亿活跃参数下,GRADE在GSM8K、MMLUPro和GPQA上均超越所有基线,在MMLUPro上以半数活跃算力领先最强基线4.8分。在强调模型深度的AIME-2025任务中仍具竞争力。消融实验表明层级结构与掩码交叉注意力是准确率提升主因,且每智能体校准对安全热插拔至关重要。
原文摘要 · Abstract (English)
Multi-agent ensembling multiplies active parameters and inference cost without answering three basic questions: which agents to consult, how deeply a query should traverse a hierarchy of agents, and when inter-agent communication is worth its cost. We present GRADE (Gated Routing and Adaptive Depth for Efficient Reasoning), a hierarchical multi-agent system in which four lightweight learned gates jointly govern agent selection, hierarchy depth, inter-agent communication, and branch pruning. Training uses CoGRPO (Collaborative Group-Relative Policy Optimization), a novel critic-free recipe that adapts GRPO to multi-agent hierarchies and assigns a shared advantage signal to every gate and agent that participated in a rollout. Agent models are drawn from a hot-swappable Expert Registry; per-agent calibration maps allow experts to be replaced at inference time without retraining. At $\sim$17B average active parameters, GRADE outperforms all baselines on GSM8K, MMLUPro, and GPQA, surpassing the strongest baseline by 4.8 points on MMLUPro at half the active compute. On AIME-2025, where model depth dominates, GRADE remains competitive to existing frameworks. Ablations isolate the hierarchy and masked cross-attention as the largest contributors to accuracy, and show that per-agent calibration is necessary for safe hot-swapping.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。