用微分方程建模连续物理时间,让世界模型更高效精准
ODEWorld: A Continuous Predictive Architecture via Physical-Time Flow

- 基于ODE构建连续潜速度场,实现物理时间下的动态建模
- 支持任意时间分辨率与反向预测,长时序重建图像质量高
- 适合机器人规划与视频生成,兼具真实感与可塑性
在我们所处的物理世界中,时空本质是连续的。然而现有机器学习的世界建模方法多局限于离散时间预测,难以高效捕捉物理动态。本文提出物理时间流(PT-Flow),通过在结构化表示空间中嵌入常微分方程(ODE),学习连续潜速度场以表征真实物理时间下的演化规律。在此框架下,未来预测被转化为压缩潜空间中的ODE求解过程。基于此,我们构建了连续时间潜世界模型ODEWorld,其通过提取时变特征并强制动力学空间与潜速度场满足ODE性质,有效缓解了潜空间模型中的表征坍缩问题。该模型在长时序预测后仍能实现高质量图像重建。其连续特性支持任意时间分辨率与反向预测,这是多数离散模型无法做到的。此外,它能提供丰富的规划导向信息,助力下游策略学习。大量实验表明,ODEWorld成功融合了利于规划的动力学抽象与视觉真实性,在视频生成与机器人控制任务中均表现优异。
原文摘要 · Abstract (English)
In the physical world we inhabit, space and time are fundamentally continuous. However, existing machine learning paradigms for world modeling are largely confined to discrete-time prediction, thereby exhibiting significant inefficiency in capturing the dynamics of physical world. We introduce Physical-Time Flow (PT-Flow), a novel approach that learns a continuous latent velocity field operating in physical time. Crucially, the underlying dynamics of sequential data are parameterized by an ordinary differential equation (ODE) embedded in a well-structured representation space. Under this paradigm, the prediction of future can be recast as temporal integration via an ODE solver in the compressed latent space. Building upon PT-Flow, we construct ODEWorld, a continuous-time latent world model that is both efficient and versatile. By extracting time-variant features and enforcing ODE properties on both the dynamical representation space and the latent velocity field, ODEWorld effectively addresses the long-standing representation collapse issue in latent world model literature. This also enables high-quality image reconstruction even after long-horizon prediction. Moreover, its continuous nature allows for arbitrary temporal resolution and even backward prediction, which is impossible for most discrete-time models. Lastly, ODEWorld can provide rich planning-oriented information to facilitate downstream policy learning. Comprehensive experiments demonstrate that ODEWorld successfully reconciles planning-conducive dynamics abstraction with visual realism, excelling in both video generation and robotic control. Project page: https://dstate.github.io/odeworld_website/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。