arXiv:2603.14392cs.LGcs.RO2026-03被引 1

用结构知识提升机器人轨迹预测的可扩展性,支持零样本泛化。

WestWorld: A Knowledge-Encoded Scalable Trajectory World Model for Diverse Robotic Systems

  • 基于系统感知的专家混合模型动态路由专用专家
  • 在89个环境上预训练后,零样本预测性能显著提升
  • 适合需要跨机器人泛化的强化学习与控制研究者

轨迹世界模型在机器人动力学学习、规划与控制中至关重要。现有方法虽尝试应用于多样化机器人系统,但难以扩展至大量不同动力学场景,且忽略物理结构领域的先验知识。为此,我们提出WestWorld——一种知识编码的可扩展轨迹世界模型。为解决可扩展性问题,设计了系统感知的专家混合(Sys-MoE),通过可学习的系统嵌入动态组合并路由针对不同机器人的专用专家。为进一步提升零样本泛化能力,引入结构嵌入,使轨迹表示与机器人形态信息对齐。在涵盖仿真与真实场景的89个复杂环境中预训练后,WestWorld在零样本与少样本轨迹预测任务上显著优于基线方法,并在多种机器人环境中展现出优异的可扩展性,显著提升下游模型驱动控制性能。最终在真实世界单位树Go1机器人上部署,实现稳定运动表现。代码已开源。

原文摘要 · Abstract (English)

Trajectory world models play a crucial role in robotic dynamics learning, planning, and control. While recent works have explored trajectory world models for diverse robotic systems, they struggle to scale to a large number of distinct system dynamics and overlook domain knowledge of physical structures. To address these limitations, we introduce WestWorld, a knoWledge-Encoded Scalable Trajectory World model for diverse robotic systems. To tackle the scalability challenge, we propose a novel system-aware Mixture-of-Experts (Sys-MoE) that dynamically combines and routes specialized experts for different robotic systems via a learnable system embedding. To further enhance zero-shot generalization, we incorporate domain knowledge of robot physical structures by introducing a structural embedding that aligns trajectory representations with morphological information. After pretraining on 89 complex environments spanning diverse morphologies across both simulation and real-world settings, WestWorld achieves significant improvements over competitive baselines in zero- and few-shot trajectory prediction. Additionally, it shows strong scalability across a wide range of robotic environments and significantly improves performance on downstream model-based control for different robots. Finally, we deploy our model on a real-world Unitree Go1, where it demonstrates stable locomotion performance. The code is available at https://github.com/511205787/WestWorld.

机器人控制轨迹建模知识编码零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。