arXiv:2506.11775cs.RO2025-06被引 7

用可穿戴外骨骼采集真人操作数据,实现机械手零样本迁移的灵巧操作。

ExoStart: Efficient learning for dexterous manipulation with sensorized exoskeleton demonstrations

  • 通过传感器外骨骼直接记录人类手部动作,无需机器人参与
  • 在仿真中生成符合动力学的轨迹,支持稀疏奖励下的自适应强化学习
  • 零样本迁移到真实机器人,在20+任务上成功率超50%

近期遥操作系统的发展使得机器人操纵器能够高效收集高质量数据,实现了大规模操控学习。这一进展表明,若能将类似能力扩展至机械手,将解锁更广泛的操纵技能,尤其是达到人类手部的灵巧程度。然而,遥操作机械手仍面临巨大挑战,因其高自由度和接触密集场景中的复杂动态特性。本文提出ExoStart,一种通用且可扩展的学习框架,利用人类灵巧性提升机械手控制能力。我们通过无机器人回路的低成本传感外骨骼直接采集演示数据,捕捉人类真实手部行为。进一步提出基于仿真的动力学滤波器,从采集数据生成动力学可行轨迹,并用于引导仅依赖简单稀疏奖励的自适应强化学习。ExoStart流程具备泛化能力,生成的策略可零样本迁移至真实机器人。结果表明,该方法能在多种复杂任务中生成灵巧的真实世界操作技能,如打开AirPods盒或插入并转动钥匙,成功率超过50%。更多细节与视频见https://sites.google.com/view/exostart。

原文摘要 · Abstract (English)

Recent advancements in teleoperation systems have enabled high-quality data collection for robotic manipulators, showing impressive results in learning manipulation at scale. This progress suggests that extending these capabilities to robotic hands could unlock an even broader range of manipulation skills, especially if we could achieve the same level of dexterity that human hands exhibit. However, teleoperating robotic hands is far from a solved problem, as it presents a significant challenge due to the high degrees of freedom of robotic hands and the complex dynamics occurring during contact-rich settings. In this work, we present ExoStart, a general and scalable learning framework that leverages human dexterity to improve robotic hand control. In particular, we obtain high-quality data by collecting direct demonstrations without a robot in the loop using a sensorized low-cost wearable exoskeleton, capturing the rich behaviors that humans can demonstrate with their own hands. We also propose a simulation-based dynamics filter that generates dynamically feasible trajectories from the collected demonstrations and use the generated trajectories to bootstrap an auto-curriculum reinforcement learning method that relies only on simple sparse rewards. The ExoStart pipeline is generalizable and yields robust policies that transfer zero-shot to the real robot. Our results demonstrate that ExoStart can generate dexterous real-world hand skills, achieving a success rate above 50% on a wide range of complex tasks such as opening an AirPods case or inserting and turning a key in a lock. More details and videos can be found in https://sites.google.com/view/exostart.

灵巧操作外骨骼强化学习零样本迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。