arXiv:2607.29302cs.ROcs.CV2026-07

低成本高保真机器人模拟器,能精准预测动作后果。

BWM: A Low-Cost High-Fidelity World Simulator for Robot Learning

论文配图:BWM: A Low-Cost High-Fidelity World Simulator for Robot Learning
图 1 · 摘自论文原文
  • 用动作条件模型结合环境引导与视觉历史,实现状态自回归预测。
  • 在WorldArena挑战中多项指标排名第一,物理机器人验证效果显著。
  • 适合需要数据增强与策略评估的机器人学习研究者使用。

可靠的机器人学习依赖于能在实际执行前预测动作后果的世界模拟器,包括危险和易出错的结果。现有物理模拟器需大量资产构建与校准,仍存在仿真到现实的差距;而视频生成模型通常对细粒度机器人动作缺乏精确控制。本文提出无边界世界模型(BWM),一个开源、低成本、高保真的机器人操作模拟器。BWM是一种动作条件的世界模型,结合初始环境引导、动态视觉历史和时序对齐的动作条件,实现状态感知的自回归未来观测预测。通过轨迹回放、重叠片段采样和初始观察增强构建动作对齐训练片段。BWM可作为数据引擎,以动作对齐的推演扩充模仿学习数据;也可作为策略评估器,支持闭环评估、风险预判与策略排序。在WorldArena基准和真实机器人上的实验表明,BWM在数据引擎与策略评估场景中均显著提升模拟器保真度与实用性。BWM在WorldArena挑战赛中,于赛道1及两个赛道2应用中均排名第一。我们发布BWM开源生态,包含模型检查点、训练与推理代码,以及数据生成与策略评估接口。

原文摘要 · Abstract (English)

Reliable robot learning requires a world simulator that can predict action consequences before execution on physical hardware, including risky and failure-prone outcomes. Existing physics simulators require substantial asset construction and calibration and still face a sim-to-real gap, while video generators often lack precise control over their responses to fine-grained robot actions. In this paper, we present the Boundless World Model (BWM), an open-source, low-cost, high-fidelity world simulator for robot manipulation. BWM is an action-conditioned world model that combines initial-environment guidance, dynamic visual history, and temporally aligned robot-action conditioning for stateful autoregressive prediction of future observations. We construct action-aligned training clips through trajectory replay, overlapping clip sampling, and initial-observation enhancement. BWM serves as a data engine that augments imitation-learning data with action-aligned rollouts, and as a policy evaluator for closed-loop assessment, risk anticipation, and policy ranking. Experiments on the WorldArena benchmark and physical robots demonstrate improved simulator fidelity and functional utility across the data-engine and policy-evaluator settings. BWM ranks first overall in the WorldArena Challenge across Track 1 and its two Track 2 applications. We release the BWM open-source ecosystem, including model checkpoints, training and inference code, and interfaces for data generation and policy evaluation.

机器人学习世界模型模拟器强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。