首个面向可变形物体的移动操作基准测试,助力机器人学习突破柔性物抓取难题。
MoDeSuite: Robot Learning Task Suite for Benchmarking Mobile Manipulation with Deformable Objects
- 构建8个真实场景启发的可变形物体操作任务,考验机器人基座与机械臂协同能力。
- 在仿真中验证先进强化与模仿学习算法性能,部分策略实现成功转移至真实机器人Spot。
- 提供完整代码与视频,推动可变形物体移动操作研究标准化发展。
移动操作是机器人在多样化真实环境中运行的关键能力,但对可变形物体的操控仍是现有机器人学习算法的重大挑战。尽管已有诸多针对刚性物体的操作评估基准,但缺乏针对移动操作中可变形物体的标准化评测体系。为此,我们提出首个专为机器人学习设计的移动操作可变形物体任务套件——MoDeSuite,包含8个不同任务,覆盖弹性与可变形物体,每项任务均源自真实应用场景。成功完成这些任务需机器人基座与机械臂高效协作,并有效利用物体的可变形特性。我们通过训练两种前沿强化学习算法和两种模仿学习算法,评估其在仿真中的表现,揭示实际困难并展示性能。进一步地,我们将训练好的策略直接部署到真实世界的Spot机器人上,验证了从仿真到现实的迁移潜力。我们预计MoDeSuite将开启可变形物体移动操作研究的新领域。更多信息、代码及视频请见:https://sites.google.com/view/modesuite/home。
原文摘要 · Abstract (English)
Mobile manipulation is a critical capability for robots operating in diverse, real-world environments. However, manipulating deformable objects and materials remains a major challenge for existing robot learning algorithms. While various benchmarks have been proposed to evaluate manipulation strategies with rigid objects, there is still a notable lack of standardized benchmarks that address mobile manipulation tasks involving deformable objects. To address this gap, we introduce MoDeSuite, the first Mobile Manipulation Deformable Object task suite, designed specifically for robot learning. MoDeSuite consists of eight distinct mobile manipulation tasks covering both elastic objects and deformable objects, each presenting a unique challenge inspired by real-world robot applications. Success in these tasks requires effective collaboration between the robot's base and manipulator, as well as the ability to exploit the deformability of the objects. To evaluate and demonstrate the use of the proposed benchmark, we train two state-of-the-art reinforcement learning algorithms and two imitation learning algorithms, highlighting the difficulties encountered and showing their performance in simulation. Furthermore, we demonstrate the practical relevance of the suite by deploying the trained policies directly into the real world with the Spot robot, showcasing the potential for sim-to-real transfer. We expect that MoDeSuite will open a novel research domain in mobile manipulation involving deformable objects. Find more details, code, and videos at https://sites.google.com/view/modesuite/home.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。