arXiv:2606.07974cs.ROcs.AI2026-06被引 4

用世界模型自身表示学习动作先验,提升规划效率

PRISM: PRior-guided Imagination Sampling in world Models

论文配图:PRISM: PRior-guided Imagination Sampling in world Models
图 1 · 摘自论文原文
  • 从世界模型中提取状态相关动作先验,无需额外网络
  • 在Cube和PushT任务上成功率分别提升35和32个百分点
  • 轻量级设计适合实时控制,不增加推理开销

学习型世界模型为未来状态评估提供了强大的物理直觉,但其在连续控制中的表现还取决于候选动作的生成方式。现有规划器通常任意搜索或仅用专家演示初始化采样均值,丢弃了专家提供的状态条件置信度。我们提出PRISM,一种无需依赖独立视觉编码器或大规模视觉语言模型的通用框架,直接从单一数据集和已训练的世界模型中提取动作先验。基于标准JEPA风格的潜在世界模型,PRISM在冻结编码器后接一个轻量MLP,预测状态相关的高斯先验。规划时,通过精度加权的高斯乘积公式将该先验融合进采样分布,实现参数无须调整、闭式求解的引导。此方法在动作置信处强化引导,在不确定处让出控制权。在Cube和PushT任务上,相比基线世界模型基于模型的强化学习(MPC),成功率分别提升35和32个百分点,且推理开销几乎不变。

原文摘要 · Abstract (English)

A learned world model provides a powerful physical intuition for evaluating future states. But its effectiveness in continuous control also depends critically on how candidate actions are generated for model-based planning. Rather than solely asking how accurately a model can simulate the future, we ask: which candidate actions are worth evaluating in the first place? Existing planners typically search arbitrarily or use expert demonstrations only to initialize a sampling mean, discarding the expert's state-conditioned confidence. Properly guiding this search requires a robust action prior, yet current approaches often rely on independent visual encoders or large-scale VLMs to obtain one. We argue that this architectural bloat is unnecessary: the exact same data - and the learned representations of the world model itself - inherently encode the agent's action intuition. We introduce PRISM, a task-agnostic framework that extracts both from a single dataset while maintaining strict architectural simplicity. Building on a standard JEPA-style latent world model, PRISM attaches a lightweight MLP directly to its frozen encoder to predict a state-conditioned Gaussian prior. At plan time, PRISM fuses this prior into the planner's sampling distribution via a precision-weighted Product-of-Gaussians update. This parameter-free, closed-form integration steers the sampling process, making the prior confident where it is and ceding control where it is not. PRISM improves success rates by 35 percentage points over vanilla world-model-based MPC on Cube and 32 percentage points on PushT, without introducing significant inference overhead.

世界模型动作先验强化学习规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。