让大模型用符号世界模型做多步规划,更可靠。
Deliberate Planning in Language Models with Symbolic Representation
- 用符号环境替代纯语言推理,实现结构化规划
- 在PlanBench上生成的计划更连贯、多样且可验证
- 适合需要逻辑严谨性的复杂任务规划场景
规划仍是大语言模型的核心挑战,尤其在需遵循外部约束的多步动作序列场景中。本文提出SymPlanner框架,通过将大模型与符号环境对接,构建显式世界模型,实现结构化规划。策略模型提出动作,符号环境确定性执行并验证其效果。为增强探索和鲁棒性,引入迭代修正(IC)机制,利用环境反馈修正无效决策;同时采用对比排序(CR),对候选计划进行联合评估。该框架模拟了错误监控修复(IC)和选项偏好形成(CR)两种认知能力,推动更符合认知规律、符号基础的规划。在PlanBench上的实验表明,相比纯自然语言基线,SymPlanner生成的计划更具连贯性、多样性和可验证性。
原文摘要 · Abstract (English)
Planning remains a core challenge for large language models (LLMs), particularly in domains that require coherent multi-step action sequences grounded in external constraints. We introduce SymPlanner, a novel framework that equips LLMs with structured planning capabilities by interfacing them with a symbolic environment that serves as an explicit world model. Rather than relying purely on natural language reasoning, SymPlanner grounds the planning process in a symbolic state space, where a policy model proposes actions and a symbolic environment deterministically executes and verifies their effects. To enhance exploration and improve robustness, we introduce Iterative Correction (IC), which refines previously proposed actions by leveraging feedback from the symbolic environment to eliminate invalid decisions and guide the model toward valid alternatives. Additionally, Contrastive Ranking (CR) enables fine-grained comparison of candidate plans by evaluating them jointly. Conceptually, SymPlanner operationalizes two cognitive faculties: (i) error monitoring and repair via externalized feedback (IC) and (ii) preference formation among alternatives via pairwise comparison (CR), advancing cognitively plausible, symbol-grounded planning aligned with the rich structure in intelligent systems. We evaluate SymPlanner on PlanBench, demonstrating that it produces more coherent, diverse, and verifiable plans than pure natural language baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。