用分块动态建模提升机器人长程规划精度
Prismatic World Model: Learning Compositional Dynamics for Planning in Hybrid Systems
- 分治式专家网络自动识别物理状态,精准预测不同运动模式
- 在高维人形机器人任务中,轨迹推演误差显著降低
- 适合需要精确物理推理的机器人控制与强化学习场景
基于模型的机器人规划面临物理动态混合性的挑战,连续运动常被接触、撞击等离散事件打断。传统隐空间世界模型采用整体神经网络,强制全局连续性,导致不同动态模式(如粘滞与滑动、飞行与站立)被过度平滑。这对规划器而言,在长时展望中会引发累积误差,使搜索过程在物理边界不可靠。为此,我们提出结构化架构普里斯马世界模型(PRISM-WM),将复杂混合动态分解为可组合的基元。该模型采用上下文感知的专家混合(MoE)框架,门控机制隐式识别当前物理模式,专用专家预测对应的状态转移动态。进一步引入潜在正交化目标,确保专家多样性,防止模式坍缩。通过建模系统动态中的模式转换,PRISM-WM有效减少轨迹推演漂移。在连续控制基准测试中,包括高维人形机器人与多任务设置,实验表明其为轨迹优化算法(如TD-MPC)提供了高保真基础,展现出作为基于模型智能体基础模型的潜力。
原文摘要 · Abstract (English)
Model-based planning in robotic domains is challenged by the hybrid nature of physical dynamics, where continuous motion is punctuated by discrete events such as contacts and impacts. Conventional latent world models typically employ monolithic neural networks that enforce global continuity, which over-smooths distinct dynamic modes (e.g., sticking vs. sliding, flight vs. stance). For a planner, this smoothing results in compounding errors during long-horizon lookaheads, rendering the search process unreliable at physical boundaries. To address this, we introduce the Prismatic World Model (PRISM-WM), a structured architecture designed to decompose complex hybrid dynamics into composable primitives. PRISM-WM uses a context-aware Mixture-of-Experts (MoE) framework where a gating mechanism implicitly identifies the current physical mode, and specialized experts predict the associated transition dynamics. We further introduce a latent orthogonalization objective to ensure expert diversity, preventing mode collapse. By modeling the mode transitions in system dynamics, PRISM-WM reduces rollout drift. Experiments on continuous control benchmarks, including high-dimensional humanoids and multi-task settings, demonstrate that PRISM-WM provides a high-fidelity substrate for trajectory optimization algorithms (e.g., TD-MPC), indicating its potential as a foundational model for model-based agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。