arXiv:2606.26217cs.LGcs.CV2026-06被引 1

用前缀预测加速视觉世界模型规划,减少误差累积。

Fast LeWorldModel

论文配图:Fast LeWorldModel
图 1 · 摘自论文原文
  • 以动作前缀为单位并行预测未来状态,替代逐步滚动
  • 规划时间大幅下降,长时程预测误差增长变缓
  • 适合需要高效视觉规划的机器人与强化学习任务

联合嵌入预测架构(JEPAs),包括最新的LeWorldModel(LeWM),已成为无重建视觉世界模型的有力基础。然而,对于视觉规划,LeWM通过反复应用局部单步潜在转移模型来评估候选动作序列,这种自回归滚动生成使规划计算成本高昂,并随规划时长增加导致预测轨迹的误差累积。我们提出Fast LeWorldModel(Fast-LeWM),一种快速潜在世界模型,将重复的局部滚动替换为动作前缀预测。给定当前潜在状态和候选动作序列,Fast-LeWM对动作前缀进行编码并并行预测执行这些前缀后到达的未来潜在状态。通过将动作前缀作为基本预测单元,Fast-LeWM直接建模不同动作前缀在多个时程下累积的动作效应。这种前缀级监督迫使模型学习状态在不同动作前缀下的连续演化规律,而非仅拟合单步状态转移。规划时,预测器可利用编码动作序列的最后一个前缀标记,直接评估对应未来潜在状态,无需显式滚动每个中间想象状态。在多个任务上,Fast-LeWM在平均成功率上优于LeWM,同时显著降低规划时间,实现更低的开环潜在损失,且其增长随滚动时程延长明显减缓。

原文摘要 · Abstract (English)

Joint-Embedding Predictive Architectures (JEPAs), including recent LeWorldModel (LeWM), have become a promising foundation for reconstruction-free visual world models. For visual planning, however, LeWM evaluates candidate action sequences by repeatedly applying a local one-step latent transition model. This autoregressive rollout makes planning computationally expensive and exposes the predicted trajectory to accumulated latent errors as the horizon grows. We propose Fast LeWorldModel (Fast-LeWM), a fast latent world model that replaces repeated local rollout with action-prefix prediction. Given the current latent and a candidate action sequence, Fast-LeWM encodes its prefixes and predicts the future latents reached after executing those prefixes in parallel. By making action prefixes the basic prediction unit, Fast-LeWM directly models action effects accumulated to different extents over multiple horizons. This prefix-level supervision forces the model to learn how states continuously evolve under different action prefixes, rather than only fitting one-step state transitions. During planning, the predictor can use the last prefix token from the encoded action sequence to evaluate the corresponding future latent without explicitly rolling through each intermediate imagined state. Across multiple tasks, Fast-LeWM improves average success over LeWM while substantially reducing planning time, achieving lower open-loop latent loss whose growth becomes significantly slower as the rollout horizon increases.

视觉规划世界模型动作前缀加速推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。