用漂移生成模型实现机器人世界建模的高速推理,1次前向传播即可完成未来帧预测。
DriftWorld: Fast World Modeling through Drifting

- 训练时学习动作条件漂移,推理时单步生成未来帧
- 推理速度达30+帧/秒,比扩散模型快17倍
- 适用于在线控制与离线策略评估,性能领先
预测性世界模型使机器人可通过想象行动结果进行规划,但其控制价值取决于能否快速生成大量轨迹。扩散模型在推理时需多步去噪,导致每条轨迹计算成本高,限制了大规模动作搜索。本文提出基于漂移生成模型的DriftWorld,训练时学习动作条件漂移,在推理时仅需一次前向传播即可从当前观测和候选动作序列生成未来帧,实现30+帧/秒的推理速度,平均比扩散基线快17倍。在Bridge-V2、RT-1、Language Table、Push-T和Robomimic等标准视觉机器人操作基准上评估,DriftWorld生成的轨迹兼具准确性与高效性,决策性能达到当前最优,且推理时间远低于基线。此外,它还能作为离线仿真器对真实机器人策略进行排序,基于轨迹评分的相关系数高达0.99。结果表明,漂移模型是机器人世界建模的理想选择,能直接支持快速高质量的规划与策略评估。
原文摘要 · Abstract (English)
Predictive world models enable robots to plan by imagining the outcomes of their actions, but their value for control hinges on generating many rollouts quickly. This creates a bottleneck for diffusion-based world models: multistep sampling makes each rollout expensive, limiting large-scale action search at inference time. We introduce DriftWorld, an action-conditioned world model based on drifting generative models. Rather than denoising iteratively at inference, DriftWorld learns an action-conditioned drift during training, allowing it to generate future frames from the current observation and a candidate action sequence in a single forward pass at 30+ fps, which is 17x faster on average than diffusion based baselines. We evaluate DriftWorld on standard vision-based robotic manipulation benchmarks, including Bridge-V2, RT-1, Language Table, Push-T, and Robomimic. By producing rollouts that are both accurate and fast, DriftWorld achieves state-of-the-art decision-making performance with far less inference time than diffusion-based world model baselines. Beyond online control, DriftWorld can also serve as an offline simulator for ranking real-world robot policies, with rollout-based scores correlating with ground truth at up to 0.99. These results show that drifting models are a strong fit for robot world modeling, where fast, high-quality imagination directly supports planning and policy evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。