无需调参,纯仿真训练的机械手实现真实世界的精准抓取与翻转。
Closing the Reality Gap: Zero-Shot Sim-to-Real Deployment for Dexterous Force-Based Grasping and Manipulation
- 用触觉+扭矩信号联合建模,提升仿真到现实的迁移能力。
- 在真实五指手上实现力控抓取和物体重定位,零微调成功执行。
- 首次实现全仿真训练的多指手零样本部署,适合机器人操控研究者。
具备多指的人类级灵巧手虽具强大操作能力,但因接触物理复杂和执行器不完美,直接部署控制策略仍困难。本文提出一种实用的仿真到现实强化学习框架,结合密集触觉反馈与关节扭矩感知,显式调控物理交互。为实现高效迁移,引入:(i) 基于并行正向运动学的快速触觉模拟,提供高频率、高分辨率的触觉信号;(ii) 电流到扭矩的校准方法,无需真实扭矩传感器即可估算扭矩;(iii) 执行器动力学建模,通过随机化间隙、扭矩-速度饱和等非理想效应填补执行差异。使用完全在仿真中训练的非对称演员-评论家PPO算法,策略直接部署至五指手。结果表明,策略可稳定完成两种关键任务:(1) 命令驱动的可控抓力跟踪;(2) 手内物体重定向。两项任务均无需微调即在真实机器人上成功执行。通过融合触觉与扭矩观测,并有效建模感知与执行,本系统为实现可靠灵巧操作提供了可行方案。据我们所知,这是首个在多指灵巧手上完全通过仿真训练并实现零样本现实部署的可控抓取演示。
原文摘要 · Abstract (English)
Human-like dexterous hands with multiple fingers offer human-level manipulation capabilities, but training control policies that can directly deploy on real hardware remains difficult due to contact-rich physics and imperfect actuation. We close this gap with a practical sim-to-real reinforcement learning (RL) framework that utilizes dense tactile feedback combined with joint torque sensing to explicitly regulate physical interactions. To enable effective sim-to-real transfer, we introduce (i) a computationally fast tactile simulation that computes distances between dense virtual tactile units and the object via parallel forward kinematics, providing high-rate, high-resolution touch signals needed by RL; (ii) a current-to-torque calibration that eliminates the need for torque sensors on dexterous hands by mapping motor current to joint torque; and (iii) actuator dynamics modeling to bridge the actuation gaps with randomization of non-ideal effects such as backlash, torque-speed saturation. Using an asymmetric actor-critic PPO pipeline trained entirely in simulation, our policies deploy directly to a five-finger hand. The resulting policies demonstrated two essential skills: (1) command-based, controllable grasp force tracking, and (2) reorientation of objects in the hand, both of which were robustly executed without fine-tuning on the robot. By combining tactile and torque in the observation space with effective sensing/actuation modeling, our system provides a practical solution to achieve reliable dexterous manipulation. To our knowledge, this is the first demonstration of controllable grasping on a multi-finger dexterous hand trained entirely in simulation and transferred zero-shot on real hardware.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。