分离动态预测提升世界模型效率,实现在机器人任务中的快速高精度推理
DDP-WM: Disentangled Dynamics Prediction for Efficient World Models
- 将场景动态分解为稀疏主动力学与背景辅助更新,通过动态定位与交叉注意力实现高效建模
- 在Push-T任务中推理速度提升9倍,MPC成功率从90%升至98%
- 适合需实时高精度规划的机器人系统,尤其复杂交互场景
世界模型对自主机器人规划至关重要,但现有基于密集Transformer的模型计算开销大,难以实现实时部署。为解决这一效率-性能瓶颈,我们提出DDP-WM,一种基于解耦动态预测(Disentangled Dynamics Prediction, DDP)的新世界模型。我们假设观测场景的潜在状态演化具有异质性,可分解为由物理交互驱动的稀疏主动力学和由上下文驱动的次要背景更新。DDP-WM通过融合高效历史处理与动态定位机制,实现主动力学的隔离。利用交叉注意力机制进行背景更新,优化资源分配并为规划器提供平滑优化空间。大量实验表明,DDP-WM在导航、精确桌面操作及复杂可变形或多重体交互等多样化任务中均实现显著效率与性能提升。特别是在具有挑战性的Push-T任务中,其推理速度相比最先进密集模型提升约9倍,且模型预测控制(MPC)成功率从90%提升至98%。结果为开发高效、高保真世界模型提供了可行路径。代码已公开于https://hcplab-sysu.github.io/DDP-WM/。
原文摘要 · Abstract (English)
World models are essential for autonomous robotic planning. However, the substantial computational overhead of existing dense Transformerbased models significantly hinders real-time deployment. To address this efficiency-performance bottleneck, we introduce DDP-WM, a novel world model centered on the principle of Disentangled Dynamics Prediction (DDP). We hypothesize that latent state evolution in observed scenes is heterogeneous and can be decomposed into sparse primary dynamics driven by physical interactions and secondary context-driven background updates. DDP-WM realizes this decomposition through an architecture that integrates efficient historical processing with dynamic localization to isolate primary dynamics. By employing a crossattention mechanism for background updates, the framework optimizes resource allocation and provides a smooth optimization landscape for planners. Extensive experiments demonstrate that DDP-WM achieves significant efficiency and performance across diverse tasks, including navigation, precise tabletop manipulation, and complex deformable or multi-body interactions. Specifically, on the challenging Push-T task, DDP-WM achieves an approximately 9 times inference speedup and improves the MPC success rate from 90% to98% compared to state-of-the-art dense models. The results establish a promising path for developing efficient, high-fidelity world models. Codes is available at https://hcplab-sysu.github.io/DDP-WM/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。