用视频模型模拟真实环境,高效评估机器人策略表现。
WorldGym: World Model as An Environment for Policy Evaluation
- 基于自回归视频生成的虚拟环境,输入初始帧即可模拟机器人动作
- 模型内策略成功率与真实世界高度相关,且保持不同版本间排名顺序
- 适合快速测试机器人在新任务和环境中的泛化能力
机器人策略评估困难:真实测试成本高,手工仿真器需大量人力提升真实感与通用性。我们提出基于世界模型的评估环境 WorldGym,一个自回归、动作条件化的视频生成模型,作为真实环境的代理。通过在世界模型中进行蒙特卡洛轨迹回放,并由视觉-语言模型提供奖励,我们仅用真实机器人初始帧评估了一组基于视觉-语言-动作(VLA)的策略,发现模型内成功率与真实世界高度相关。此外,WorldGym能保持不同策略版本、规模及训练检查点间的相对排名。由于只需单个起始帧输入,该模型可高效评估策略在新任务和新环境中的泛化能力。我们发现现代 VLA 策略仍难以区分物体形状,易被物体的对抗性外观干扰。尽管物体交互生成仍具挑战,WorldGym 能忠实模拟机器人运动,为部署前提供安全、可复现的策略评估方案。
原文摘要 · Abstract (English)
Evaluating robot control policies is difficult: real-world testing is costly, and handcrafted simulators require manual effort to improve in realism and generality. We propose a world-model-based policy evaluation environment (WorldGym), an autoregressive, action-conditioned video generation model which serves as a proxy to real world environments. Policies are evaluated via Monte Carlo rollouts in the world model, with a vision-language model providing rewards. We evaluate a set of VLA-based real-robot policies in the world model using only initial frames from real robots, and show that policy success rates within the world model highly correlate with real-world success rates. Moreoever, we show that WorldGym is able to preserve relative policy rankings across different policy versions, sizes, and training checkpoints. Due to requiring only a single start frame as input, the world model further enables efficient evaluation of robot policies' generalization ability on novel tasks and environments. We find that modern VLA-based robot policies still struggle to distinguish object shapes and can become distracted by adversarial facades of objects. While generating highly realistic object interaction remains challenging, WorldGym faithfully emulates robot motions and offers a practical starting point for safe and reproducible policy evaluation before deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。