用学习的转移模型提升规划样本效率,更省数据更准。
On Sample-Efficient Generalized Planning via Learned Transition Models
- 通过学习显式转移模型,自动预测状态演化而非直接输出动作序列。
- 在多个领域中,用更少数据和更小模型达到更高跨域规划成功率。
- 适合关注小样本、高效通用规划的研究者或应用开发者。
广义规划旨在构建可泛化于共享同一领域模型(由转移函数γ: S × A → S 定义)的一类规划问题的解策略。传统方法依赖符号抽象和对γ的显式推理;而近期基于Transformer的规划器(如PlanGPT、Plansformer)将广义规划视为直接的动作序列预测,跳过了显式转移建模。尽管在分布内任务上表现良好,但这类方法通常需要大量数据和庞大模型,在长时序设置下常因缺乏显式世界状态演进而出现状态漂移。本文将广义规划重新定义为转移模型学习问题:神经网络显式逼近后继状态函数γ̂ ≈ γ,通过符号状态轨迹滚动生成计划。模型自回归预测中间世界状态,从而隐式学习领域动态。我们系统评估了多种状态表示与神经架构(包括关系图编码),结果表明,显式学习转移模型在多个领域中实现更高的跨域满意解成功率,且所需训练实例更少、模型更小。本工作为2026年ICAPS会议同名短文的扩展版本。
原文摘要 · Abstract (English)
Generalized planning studies the construction of solution strategies that generalize across families of planning problems sharing a common domain model, formally defined by a transition function $γ: S \times A \rightarrow S$. Classical approaches achieve such generalization through symbolic abstractions and explicit reasoning over $γ$. In contrast, recent Transformer-based planners, such as PlanGPT and Plansformer, largely cast generalized planning as direct action-sequence prediction, bypassing explicit transition modeling. While effective on in-distribution instances, these approaches typically require large datasets and model sizes, and often suffer from state drift in long-horizon settings due to the absence of explicit world-state evolution. In this work, we formulate generalized planning as a transition-model learning problem, in which a neural model explicitly approximates the successor-state function $\hatγ \approx γ$ and generates plans by rolling out symbolic state trajectories. Instead of predicting actions directly, the model autoregressively predicts intermediate world states, thereby learning the domain dynamics as an implicit world model. To study size-invariant generalization and sample efficiency, we systematically evaluate multiple state representations and neural architectures, including relational graph encodings. Our results show that learning explicit transition models yields higher out-of-distribution satisficing-plan success than direct action-sequence prediction in multiple domains, while achieving these gains with significantly fewer training instances and smaller models. This is an extended version of a short paper accepted at ICAPS 2026 under the same title.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。