arXiv:2607.04940cs.RO2026-07被引 6

无需调参,纯仿真训练的灵巧手可直接在真实机器人上实现精准抓握与翻转。

Closing the Reality Gap: Zero-Shot Sim-to-Real Deployment for Dexterous Force-Based Grasping and Manipulation

论文配图:Closing the Reality Gap: Zero-Shot Sim-to-Real Deployment for Dexterous Force-Based Grasping and Manipulation
图 1 · 摘自论文原文
  • 融合触觉与力矩反馈,通过仿真模拟高精度触感信号。
  • 零样本部署下实现抓握力精确控制与物体自主翻转,无需微调。
  • 适用于需高精度操作的工业场景,如装配、分拣等任务。

人类级灵巧手具备多指操控能力,但因接触物理复杂和执行器不理想,难以在真实硬件上部署控制策略。本文提出一种基于强化学习的仿真到现实迁移方法,结合密集触觉反馈与关节力矩感知以显式调控物理交互。为实现有效迁移,提出:(i) 快速触觉仿真,通过并行正运动学计算虚拟触点与物体距离,提供高频率、高分辨率的触觉信号;(ii) 电流-力矩校准,无需力矩传感器即可将电机电流映射为关节力矩;(iii) 随机化建模执行器动态特性,弥补非理想力矩-速度效应。采用异步演员-评论家PPO框架,在仿真中完全训练策略,并直接部署至五指机械手。结果表明,该策略可稳定完成两项核心人手技能:(1) 基于指令的可控抓握力跟踪;(2) 手中物体重定位。两项任务均在真实机器人上零样本成功执行,无需微调。通过在观测空间融合触觉与力矩信息,并实现可扩展的传感与执行建模,本系统为实现可靠灵巧操作提供了实用方案。据我们所知,这是首个在多指灵巧手上完全于仿真训练并零样本转移到真实硬件的可控抓握演示。

原文摘要 · Abstract (English)

Human-like dexterous hands with multiple fingers offer human-level manipulation capabilities but remain difficult to train the control policies that can deploy on real hardware due to contact-rich physics and imperfect actuation. We present a sim-to-real reinforcement learning method that leverages dense tactile feedback combined with joint torque sensing to explicitly regulate physical interactions. To enable effective sim-to-real transfer, we introduce (i) a computationally fast tactile simulation that computes distances between dense virtual tactile units and the object via parallel forward kinematics, providing high-rate, high-resolution touch signals needed by RL; (ii) a current-to-torque calibration that eliminates the need for torque sensors on dexterous hands by mapping motor current to joint torque; and (iii) actuator dynamics modeling with randomization to account for non-ideal torque-speed effects and bridge the actuation gaps. Using an asymmetric actor-critic PPO pipeline, we train policies entirely in simulation and deploy them directly to a five-finger hand. The resulting policies demonstrate two essential human-hand skills: (1) command-based controllable grasp force tracking and (2) reorientation of objects in the hand, both of which are robustly executed without fine-tuning on the robot. By combining tactile and torque in the observation space with scalable sensing and actuation modeling, our system provides a practical solution to achieve reliable dexterous manipulation. To our knowledge, this is the first demonstration of controllable grasping on a multi-finger dexterous hand trained entirely in simulation and transferred zero-shot on real hardware.

灵巧操作仿真到现实触觉反馈强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。