arXiv:2504.18904cs.RO2025-04被引 76

构建机器人学习统一平台,解决数据与评估难题。

RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learning

  • 设计可兼容多仿真器的MetaSim框架,实现环境无缝切换。
  • 提供高保真物理与真实渲染的合成数据集,支持大规模训练。
  • 推出统一基准,适用于模仿学习与强化学习的泛化评估。

数据规模化和标准化评估推动了自然语言处理与计算机视觉的显著进展,但机器人领域在数据扩展和评估协议方面面临独特挑战。真实世界数据采集成本高、效率低,而真实场景下的评测仍极为复杂。合成数据与仿真提供了可行替代方案,但现有工作在数据质量、多样性及基准标准化方面仍显不足。为此,我们提出RoboVerse,一个包含仿真平台、合成数据集和统一基准的综合框架。其仿真平台支持多种仿真器与机器人形态,实现环境间无感切换。合成数据集通过多种方法构建,具备高保真物理与照片级渲染效果。我们还提出了面向模仿学习与强化学习的统一基准,支持多层级泛化能力评估。核心是MetaSim基础设施,将异构仿真环境抽象为通用接口,重构配置系统并统一API功能,如启动环境、加载资产、步进物理引擎等,确保互操作性与可扩展性。全面实验表明,RoboVerse提升了模仿学习、强化学习、世界模型学习及仿真到现实迁移的表现,验证了数据集与基准的可靠性,确立其作为推进机器人学习的有力解决方案。

原文摘要 · Abstract (English)

Data scaling and standardized evaluation benchmarks have driven significant advances in natural language processing and computer vision. However, robotics faces unique challenges in scaling data and establishing evaluation protocols. Collecting real-world data is resource-intensive and inefficient, while benchmarking in real-world scenarios remains highly complex. Synthetic data and simulation offer promising alternatives, yet existing efforts often fall short in data quality, diversity, and benchmark standardization. To address these challenges, we introduce RoboVerse, a comprehensive framework comprising a simulation platform, a synthetic dataset, and unified benchmarks. Our simulation platform supports multiple simulators and robotic embodiments, enabling seamless transitions between different environments. The synthetic dataset, featuring high-fidelity physics and photorealistic rendering, is constructed through multiple approaches. Additionally, we propose unified benchmarks for imitation learning and reinforcement learning, enabling evaluation across different levels of generalization. At the core of the simulation platform is MetaSim, an infrastructure that abstracts diverse simulation environments into a universal interface. It restructures existing simulation environments into a simulator-agnostic configuration system, as well as an API aligning different simulator functionalities, such as launching simulation environments, loading assets with initial states, stepping the physics engine, etc. This abstraction ensures interoperability and extensibility. Comprehensive experiments demonstrate that RoboVerse enhances the performance of imitation learning, reinforcement learning, world model learning, and sim-to-real transfer. These results validate the reliability of our dataset and benchmarks, establishing RoboVerse as a robust solution for advancing robot learning.

机器人学习仿真平台合成数据基准评测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。