arXiv:2509.19077cs.AI2025-09

用代码生成计划并自适应评估,降低大模型规划成本。

Code Driven Planning with Domain-Adaptive Critic

  • 用高层代码程序生成多种计划,迭代优化
  • 成功率达78.5%,查询成本下降91.27%
  • 适合需要长期规划的复杂任务场景

大型语言模型(LLMs)被广泛用于序列决策任务中的任务规划,借助其丰富的世界知识。然而,通用知识与环境特定需求之间的差距常导致计划不准确。现有方法依赖频繁调用LLM,基于即时环境反馈迭代修正计划,但此类反馈仅关注短期回报,难以引导长期目标对齐。为此,本文提出代码驱动规划与领域自适应评判器(CoPiC)。CoPiC不依赖频繁调用,而是让LLM生成多样化的高层规划代码,迭代产生并优化候选计划;再由训练好的领域自适应评判器评估各计划,选择最契合长期奖励的方案执行。通过将高层规划代码作为规划器、领域自适应评判器作为评估器,CoPiC在显著降低查询成本的同时提升规划质量。在ALFWorld、NetHack和StarCraft II单位建造任务中,CoPiC优于先进基线方法AdaPlanner和Reflexion,平均成功率提升23.33%,查询成本减少91.27%。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have been widely adopted as task planners for AI agents in sequential decision-making problems, leveraging their extensive world knowledge. However, the gap between their general knowledge and environment-specific requirements often leads to inaccurate plans. To address this, existing approaches rely on frequent LLM queries to iteratively refine plans based on immediate environmental feedback, which incurs substantial query costs. However, this refinement is typically guided by short-term environmental feedback, limiting LLMs from developing plans aligned with long-term rewards. We propose Code Driven Planning with Domain-Adaptive Critic (CoPiC). Instead of relying on frequent queries, CoPiC employs LLMs to generate a diverse set of high-level planning programs, which iteratively produce and refine candidate plans. A trained domain-adaptive critic then evaluates these candidates and selects the one most aligned with long-term rewards for execution. Using high-level planning programs as planner and domain-adaptive critic as estimator, CoPiC improves planning while significantly reducing query costs. Results in ALFWorld, NetHack, and StarCraft II Unit Building show that CoPiC outperforms advanced LLM-based baselines, AdaPlanner and Reflexion, achieving an average (1) 23.33% improvement in success rate and (2) 91.27% reduction in query costs.

大模型规划代码生成自适应评判低开销

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。