arXiv:2503.09572cs.CL2025-03ICML被引 209

让AI智能体更会规划,提升复杂长任务成功率

Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks

  • 分离规划与执行,用合成数据训练更精准的计划模型
  • 在网页导航任务中达到57.58%成功率,刷新文本类表现纪录
  • 适合需要长期规划的AI助手、自动化工具研发者使用

大型语言模型在处理简单任务方面已取得显著进展,但在复杂、多步骤、长周期任务上仍面临挑战。近期研究发现,将高层规划与底层执行分离可有效平衡目标与细节。然而,由于大模型本身未专门训练生成准确计划,该任务仍具难度。为此,我们提出Plan-and-Act框架,通过引入显式规划机制,并设计一种新型合成数据生成方法,提升计划生成能力。该框架包含规划器(Planner)和执行器(Executor)两部分:规划器生成结构化高层计划以达成用户目标,执行器将计划转化为环境特定动作。为有效训练规划器,我们提出一种合成数据生成方法,将真实轨迹标注为可行计划,并加入多样且丰富的示例以增强泛化性。我们在网页导航这一典型长周期任务环境中评估该框架,在WebArena-Lite基准上实现57.58%的成功率,且在仅文本输入的WebVoyager上达到81.36%的当前最优成绩。

原文摘要 · Abstract (English)

Large language models (LLMs) have shown remarkable advancements in enabling language agents to tackle simple tasks. However, applying them for complex, multi-step, long-horizon tasks remains a challenge. Recent work have found success by separating high-level planning from low-level execution, which enables the model to effectively balance high-level planning objectives and low-level execution details. However, generating accurate plans remains difficult since LLMs are not inherently trained for this task. To address this, we propose Plan-and-Act, a novel framework that incorporates explicit planning into LLM-based agents and introduces a scalable method to enhance plan generation through a novel synthetic data generation method. Plan-and-Act consists of a Planner model which generates structured, high-level plans to achieve user goals, and an Executor model that translates these plans into environment-specific actions. To train the Planner effectively, we introduce a synthetic data generation method that annotates ground-truth trajectories with feasible plans, augmented with diverse and extensive examples to enhance generalization. We evaluate Plan-and-Act using web navigation as a representative long-horizon planning environment, demonstrating a state-of-the-art 57.58% success rate on the WebArena-Lite benchmark as well as a text-only state-of-the-art 81.36% success rate on WebVoyager.

智能体长周期任务规划生成合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。