构建可扩展的虚实迁移平台,实现家用移动操作任务的无缝仿真与真实部署。
A Scalable Embodied Intelligence Platform for Seamless Real-to-Sim-to-Real Transfer of Household Mobile Manipulation Tasks

- 自动场景生成模块从真实观测重建高保真仿真环境。
- 支持混合技能策略的大规模仿真评估与灵活集成。
- 统一中间件使不同硬件机器人实现兼容的虚实迁移。
移动操作是具身智能机器人的重要能力。随着对非结构化家庭环境中鲁棒且通用操作需求的增长,具身智能平台迅速发展。然而,实现真实-仿真-真实间的无缝迁移面临三大挑战:高保真仿真场景重建成本高、仿真中系统性策略评估复杂,以及真实部署不兼容。为此,我们提出BestMan平台,一个可扩展且无缝的实时到仿真再到真实的迁移平台,弥合仿真与真实世界的差距,支持家庭移动操作任务的策略开发、整合与部署。具体而言,我们设计了自动化场景生成(ASG)模块,从真实观测重建逼真仿真环境;提出仿真引导的任务形式化与技能学习架构,支持混合技能策略在仿真中的灵活整合与大规模评估;为提升真实世界可扩展性,开发了硬件无关的统一中间件(HUM),确保异构移动操作机器人在仿真到真实迁移中的无缝兼容。实验结果表明,该平台在建立标准化基准和推动移动操作研究方面表现优异。
原文摘要 · Abstract (English)
Mobile manipulation is a fundamental capability in embodied intelligence robotics. The growing demand for robust and generalizable manipulation in unstructured household environments has driven rapid progress in embodied intelligence platforms. However, achieving a seamless transfer across the real-to-sim-to-real cycle faces three key challenges, including costly high-fidelity simulation scenes reconstruction, the complexity of systematic strategy evaluation in simulation, and incompatible real-world deployments. To address these challenges, we develop BestMan, a scalable and seamless real-to-sim-to-real platform that bridges the gap between the simulation and the real world, enabling effective strategy development, integration, and deployment for household mobile manipulation. Specifically, we design a novel Automated Scene Generation (ASG) module to reconstruct realistic simulations from real observations. Then, we propose a simulation-guided task formalization and skill learning architecture that supports the flexible integration and large-scale evaluations of hybrid skill strategies in simulation. Finally, to enhance the real-world scalability, we develop a Hardware-agnostic and Unified Middleware (HUM) to ensure seamless and compatible sim-to-real transfer across heterogeneous mobile manipulators for real deployments. Experimental results demonstrate the superior performance of our proposed platform in establishing standardized benchmarks and facilitating promising research in the field of mobile manipulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。