让大模型用迭代方式生成逻辑一致的规划代码,提升长程任务规划成功率。
PDDLCoder: Agentic PDDL Generation for LLM-Assisted Symbolic Planning
- 设计智能体框架,分步生成、分析并优化规划语言代码
- 在4个新领域上实现89.6%的可执行计划率,显著优于旧方法
- 提供可自动验证的基准数据集,适合做符号规划与大模型结合研究
大模型在长程规划中仍不可靠,常生成逻辑矛盾或无效的计划。现有混合方法将自然语言转为规划域定义语言(PDDL),由符号规划器生成可验证计划,但多依赖固定流程、不完整PDDL定义或人工反馈,且缺乏标准化评测基准。为此,我们提出PDDLCoder,一种从自然语言生成PDDL的智能体框架,通过迭代生成、分析与修正规划规范。我们还构建了NL-pddlgym,一个包含711个规划问题的基准数据集,覆盖23个领域,配有可执行的gym环境以实现计划适用性的自动化验证。在包含106个问题的4个未见领域的测试集上,PDDLCoder成功生成可应用计划的比例达89.6%,优于先前方法最高45.3%的表现,也超过直接使用大模型规划的74.5%上限。本工作证明了智能体式PDDL生成的有效性,并为未来研究提供了可复现的基准。
原文摘要 · Abstract (English)
LLMs remain unreliable for long-horizon planning, often generating logically inconsistent or non-applicable plans. Recent hybrid methods instead translate natural language into the Planning Domain Definition Language (PDDL), allowing symbolic planners to produce verifiable plans. However, existing methods frequently rely on rigid generation pipelines, a partial PDDL definition, or human feedback. Furthermore, their evaluation is hindered by the lack of standardized benchmarks with automated verification. To address these limitations, we present PDDLCoder, an agentic framework for PDDL generation from natural language that iteratively generates, analyzes, and refines planning specifications. We further introduce NL-pddlgym, a benchmark dataset comprising 711 planning problems across 23 domains with executable gym environments for the automated verification of plan applicability. Experiments on the NL-pddlgym test set containing 106 problems across 4 held-out domains show that PDDLCoder generates applicable plans for 89.6\% of tested planning problems. This improves upon our adaptations of previous PDDL generation methods, which achieved up to 45.3\%, and outperforms direct LLM planning approaches, which reached up to 74.5\% on the same test set. Our work demonstrates the effectiveness of agentic PDDL generation for planning and establishes a reproducible benchmark for future research on LLM-assisted symbolic planning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。