arXiv:2510.04592cs.RO2025-10被引 1

用数字孪生生成真实机器人动作数据,提升移动操作学习效果

MobRT: A Digital Twin-Based Framework for Scalable Learning in Mobile Manipulation

  • 构建数字孪生框架,自动生成多样且物理一致的动作示范
  • 生成轨迹越多,任务成功率越高,验证数据质量与性能正相关
  • 适合研究移动机器人操作、强化学习数据生成的学者

近期机器人发展主要依赖模仿学习,但高质量示范数据的获取仍是挑战,尤其对需协调底盘运动与机械臂操作的移动操作机器人而言。现有研究多局限于简单的桌面场景,而移动操作仍缺乏充分探索。为此,我们提出基于数字孪生的框架 MobRT,用于模拟两类复杂全身任务:与可动物体交互(如开门、开抽屉)及移动底盘抓放操作。MobRT 通过虚拟运动学控制与全身运动规划相结合,自主生成多样且真实的示范数据,实现协调一致的物理合理执行。我们在多个基线算法上评估了生成数据的质量,建立全面基准,并证实任务成功率与生成轨迹数量呈强相关性。结合仿真与真实数据的实验表明,该方法显著提升策略泛化能力与性能,在仿真和真实环境中均取得稳健结果。

原文摘要 · Abstract (English)

Recent advances in robotics have been largely driven by imitation learning, which depends critically on large-scale, high-quality demonstration data. However, collecting such data remains a significant challenge-particularly for mobile manipulators, which must coordinate base locomotion and arm manipulation in high-dimensional, dynamic, and partially observable environments. Consequently, most existing research remains focused on simpler tabletop scenarios, leaving mobile manipulation relatively underexplored. To bridge this gap, we present \textit{MobRT}, a digital twin-based framework designed to simulate two primary categories of complex, whole-body tasks: interaction with articulated objects (e.g., opening doors and drawers) and mobile-base pick-and-place operations. \textit{MobRT} autonomously generates diverse and realistic demonstrations through the integration of virtual kinematic control and whole-body motion planning, enabling coherent and physically consistent execution. We evaluate the quality of \textit{MobRT}-generated data across multiple baseline algorithms, establishing a comprehensive benchmark and demonstrating a strong correlation between task success and the number of generated trajectories. Experiments integrating both simulated and real-world demonstrations confirm that our approach markedly improves policy generalization and performance, achieving robust results in both simulated and real-world environments.

移动操作数字孪生模仿学习数据生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。