让软体机械手模仿真人抓握,关键在精确复现接触力分布。
Functional Force-Aware Retargeting from Virtual Human Demos to Soft Robot Policies
- 通过虚拟现实捕捉人体接触力数据,分阶段映射到机器人手指
- 相比传统方法,指尖轨迹误差降低55%,追踪方差减少69%
- 适合软体手抓握、跨形态迁移等高难度操作场景
我们提出SoftAct框架,通过显式建模接触力来教会软体机械手执行类人操纵技能。借助沉浸式虚拟现实,系统捕获了包括手部运动学、物体运动、密集接触区域和详细接触力在内的丰富人类示范数据。与传统仅转写关节轨迹的方法不同,SoftAct采用两阶段力感知重定向算法:第一阶段将示范接触力分配至人体各手指,并按比例分配给机器人手指,建立力平衡映射;第二阶段结合基线末端执行器位姿跟踪与测地加权接触优化,在线实时调整机器人指端目标,利用接触几何与力幅值动态修正。该方法使软体机械手能复现人类示范的功能意图,同时自然适应极端形态差异与非线性柔顺性。我们在自研的非人形气动软体机械手平台上评估,结果表明,相较于基于运动学和学习的基线方法,SoftAct控制器在指尖轨迹追踪上RMSE降低最高达55%,追踪方差减少最多69%。在策略层面,其在零样本真实世界部署和仿真中均取得更高成功率。结果证明,显式建模接触几何与力分布对有效技能迁移至关重要,无法仅靠运动学模仿恢复。项目视频及更多细节见https://soft-act.github.io/。
原文摘要 · Abstract (English)
We introduce SoftAct, a framework for teaching soft robot hands to perform human-like manipulation skills by explicitly reasoning about contact forces. Leveraging immersive virtual reality, our system captures rich human demonstrations, including hand kinematics, object motion, dense contact patches, and detailed contact force information. Unlike conventional approaches that retarget human joint trajectories, SoftAct employs a two-stage, force-aware retargeting algorithm. The first stage attributes demonstrated contact forces to individual human fingers and allocates robot fingers proportionally, establishing a force-balanced mapping between human and robot hands. The second stage performs online retargeting by combining baseline end-effector pose tracking with geodesic-weighted contact refinements, using contact geometry and force magnitude to adjust robot fingertip targets in real time. This formulation enables soft robotic hands to reproduce the functional intent of human demonstrations while naturally accommodating extreme embodiment mismatch and nonlinear compliance. We evaluate SoftAct on a suite of contact-rich manipulation tasks using a custom non-anthropomorphic pneumatic soft robot hand. SoftAct's controller reduces fingertip trajectory tracking RMSE by up to 55 percent and reduces tracking variance by up to 69 percent compared to kinematic and learning-based baselines. At the policy level, SoftAct achieves consistently higher success in zero-shot real-world deployment and in simulation. These results demonstrate that explicitly modeling contact geometry and force distribution is essential for effective skill transfer to soft robotic hands, and cannot be recovered through kinematic imitation alone. Project videos and additional details are available at https://soft-act.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。