让智能体系统自动设计并执行,实现端到端学习。
MetaAgent-X : Breaking the Ceiling of Automatic Multi-Agent Systems via End-to-End Reinforcement Learning

- 用强化学习联合优化设计者和执行者,打破固定流程限制。
- 在多个任务上提升21.7%,且双方能力随训练同步增强。
- 适合想构建自进化智能体系统的研究人员与开发者。
自动多智能体系统旨在无需人工设计流程即可生成智能体工作流。然而现有方法仅部分自适应:或采用无训练的测试时搜索,或仅优化元级设计者而冻结下游执行智能体,导致‘冻结执行者’瓶颈,使自设计、自执行智能体模型的端到端训练未被探索。为此,我们提出MetaAgent-X,一个端到端强化学习框架,联合优化自动多智能体系统的设计与执行。MetaAgent-X支持脚本化工作流生成、执行回放收集及对设计者与执行者轨迹的信用分配。为提升训练稳定性和可扩展性,提出执行者-设计者分层回放与分阶段协同进化机制,揭示了设计者与执行者的协同演化动态。实验表明,MetaAgent-X持续优于现有基线,性能最高提升21.7%。全面消融实验显示,设计者与执行者在训练中均持续提升,且有效学习遵循分阶段协同进化过程。这些结果确立了端到端可训练的自动多智能体系统作为构建自设计、自执行智能体模型的实用范式。
原文摘要 · Abstract (English)
Automatic multi-agent systems aim to instantiate agent workflows without relying on manually designed or fixed orchestration. However, existing automatic MAS approaches remain only partially adaptive: they either perform training-free test-time search or optimize the meta-level designer while keeping downstream execution agents frozen, which creating a frozen-executor ceiling and leaving the end-to-end training of self-designing and self-executing agentic models unexplored. To address this, we introduce MetaAgent-X, an end-to-end reinforcement learning framework that jointly optimizes automatic MAS design and execution. MetaAgent-X enables script-based MAS generation, execution rollout collection, and credit assignment for both designer and executor trajectories. To support stable and scalable optimization, we propose Executor Designer Hierarchical Rollout and Stagewise Co-evolution to improve training stability and expose the dynamics of designer-executor co-evolution. MetaAgent-X consistently outperforms existing automatic MAS baselines, achieving up to 21.7% gains. Comprehensive ablations show that both designer and executor improve throughout training, and that effective automatic MAS learning follows a stagewise co-evolution process. These results establish end-to-end trainable automatic MAS as a practical paradigm for building self-designing and self-executing agentic models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。