arXiv:2410.12112cs.AIcs.CL2024-10被引 50

用大模型自动生成复杂规划方案,无需特定示例即可通用求解。

Planning Anything with Rigor: General-Purpose Zero-Shot Planning with LLM-based Formalized Programming

  • 将规划问题形式化为优化问题,由大模型从零构建解决方案。
  • 在9类任务中平均达到83.7%最优率,比最佳基线提升超37%。
  • 适用于多约束、长时序等复杂场景,适合研究通用智能规划者。

尽管大语言模型在解决规划问题上展现出潜力,但灵活性与复杂性之间存在权衡。现有方法常依赖任务特异性示例或预定义验证器,限制了跨任务泛化能力。本文观察到多数规划问题本质是优化问题:在满足约束条件下寻找最优解(即最佳计划)。基于大模型的常识、推理与编程能力,提出通用框架LLMFP,可自动提取规划问题关键信息,并将其形式化为优化问题求解,无需任务特异性示例。在9个不同规划任务上测试,包括多约束决策与多步规划,LLMFP在GPT-4o和Claude 3.5 Sonnet上分别实现83.7%与86.8%的最优率,相较最优基线(OpenAI o1-preview直接规划)分别提升37.6%和40.7%。通过消融实验验证各组件有效性,并分析成功与失败原因。

原文摘要 · Abstract (English)

While large language models (LLMs) have recently demonstrated strong potential in solving planning problems, there is a trade-off between flexibility and complexity. LLMs, as zero-shot planners themselves, are still not capable of directly generating valid plans for complex planning problems such as multi-constraint or long-horizon tasks. On the other hand, many frameworks aiming to solve complex planning problems often rely on task-specific preparatory efforts, such as task-specific in-context examples and pre-defined critics/verifiers, which limits their cross-task generalization capability. In this paper, we tackle these challenges by observing that the core of many planning problems lies in optimization problems: searching for the optimal solution (best plan) with goals subject to constraints (preconditions and effects of decisions). With LLMs' commonsense, reasoning, and programming capabilities, this opens up the possibilities of a universal LLM-based approach to planning problems. Inspired by this observation, we propose LLMFP, a general-purpose framework that leverages LLMs to capture key information from planning problems and formally formulate and solve them as optimization problems from scratch, with no task-specific examples needed. We apply LLMFP to 9 planning problems, ranging from multi-constraint decision making to multi-step planning problems, and demonstrate that LLMFP achieves on average 83.7% and 86.8% optimal rate across 9 tasks for GPT-4o and Claude 3.5 Sonnet, significantly outperforming the best baseline (direct planning with OpenAI o1-preview) with 37.6% and 40.7% improvements. We also validate components of LLMFP with ablation experiments and analyzed the underlying success and failure reasons. Project page: https://sites.google.com/view/llmfp.

大模型规划优化求解零样本通用框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。