专注规划者,用少量计算实现长程任务自动化
Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planning

- 分角色协作:规划、执行、记忆管理三者分工明确
- 实验证明规划占性能主导,其他组件可大幅精简
- 仅优化规划模块,效率提升显著,适合资源受限场景
基于语言模型的智能体在自动化复杂任务方面展现出潜力,但在长程规划与推理上仍面临挑战。为此,我们提出一种增强型多智能体框架,将自动化过程分解为三个角色:负责高层决策的规划者、执行任务的执行者和管理上下文的内存管理者。尽管这种模块化设计符合现有范式,我们的核心贡献在于系统性地分析了计算资源分配,发现规划是影响任务性能的关键因素。执行和记忆管理所需计算量和模型容量远低于规划,仍能取得良好效果。基于此,我们提出一种以规划者为中心的强化学习方法,仅使用视觉语言模型作为裁判的轨迹级奖励对规划者进行优化,而冻结其余组件。在涵盖网页导航、操作系统控制和工具使用的多个基准测试中,实验表明集中资源于高层规划可带来稳健且高效的改进。代码已公开。
原文摘要 · Abstract (English)
Language model (LM)-based agents have demonstrated promising capabilities in automating complex tasks from natural language instructions, yet they continue to struggle with long-horizon planning and reasoning. To address this, we propose an enhanced multi-agent framework that decomposes automation into three roles: a planner for high-level decision-making, an actor for task execution, and a memory manager for contextual reasoning. While this modular decomposition aligns with established design patterns, our core contribution lies in a systematic compute-allocation analysis, revealing that planning is the dominant factor influencing task performance. Execution and memory management require significantly less compute and model capacity to achieve competitive results. Building on these insights, we introduce a planner-centric reinforcement learning approach, which exclusively optimizes the planner using trajectory-level rewards from a VLM-as-judge, while freezing the other components. Extensive experiments on benchmarks spanning web navigation, OS control, and tool use demonstrate that concentrating model capacity and learning on high-level planning yields robust and compute-efficient improvements in long-horizon agent automation. Our code is publicly released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。