arXiv:2411.04983cs.ROcs.AI2024-11ICML被引 334

用预训练视觉特征构建世界模型,实现零样本规划。

DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning

论文配图:DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning
图 1 · 摘自论文原文
  • 基于DINOv2的视觉补丁特征,无需重建图像即可预测未来状态。
  • 在6个环境上零样本达成目标,无需奖励模型或专家示范。
  • 适合需要通用推理与在线优化的机器人控制任务。

预测控制动作带来的未来结果是物理推理的核心能力。然而,现有世界模型通常需在线策略学习,且针对特定任务设计。为释放其潜力,我们提出DINO-WM,一种可离线训练、支持测试时行为优化、并实现任务无关推理的世界模型。DINO-WM利用DINOv2预训练的空间补丁特征,通过预测未来补丁特征来建模视觉动态,无需重建视觉世界。该方法通过优化动作序列实现观察目标,将目标特征作为预测目标,从而实现任务无关规划。我们在六个环境上验证了DINO-WM的零样本行为求解能力,包括任意配置迷宫、不同形状物体的推拉操作及多粒子场景,均无需专家示范、奖励建模或逆模型预训练,性能超越先前最先进方法。

原文摘要 · Abstract (English)

The ability to predict future outcomes given control actions is fundamental for physical reasoning. However, such predictive models, often called world models, remains challenging to learn and are typically developed for task-specific solutions with online policy learning. To unlock world models' true potential, we argue that they should 1) be trainable on offline, pre-collected trajectories, 2) support test-time behavior optimization, and 3) facilitate task-agnostic reasoning. To this end, we present DINO World Model (DINO-WM), a new method to model visual dynamics without reconstructing the visual world. DINO-WM leverages spatial patch features pre-trained with DINOv2, enabling it to learn from offline behavioral trajectories by predicting future patch features. This allows DINO-WM to achieve observational goals through action sequence optimization, facilitating task-agnostic planning by treating goal features as prediction targets. We demonstrate that DINO-WM achieves zero-shot behavioral solutions at test time on six environments without expert demonstrations, reward modeling, or pre-learned inverse models, outperforming prior state-of-the-art work across diverse task families such as arbitrarily configured mazes, push manipulation with varied object shapes, and multi-particle scenarios.

世界模型零样本规划视觉动态预训练特征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。