arXiv:2607.06438cs.ROcs.CV2026-07中稿 · ECCV

用手腕引导实现无需手指数据的全身机器人操作

WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulation

论文配图:WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulation
图 1 · 摘自论文原文
  • 以手腕为枢纽分离身体运动与手部抓取,避免直接跟踪手指姿态
  • 在多种机器人手上实现无手指监督的操控重定向,效果优于依赖完整手姿的方法
  • 适合需要跨肢体泛化的人形机器人操控任务

将人类物体交互演示迁移到物理仿真中,需同时复现身体动作、物体运动和接触关系。但仅使用手部位置轨迹无法确定操作所需的接触力,直接追踪又会过度约束富含接触的手指行为。本文提出WristMimic框架,通过显式分离无接触身体运动与富接触手部操作,使身体和手腕根据运动学目标进行控制,而手指则通过物体追踪和接触结果自主学习抓握与操作行为。关键洞察在于:手腕几乎不受接触影响,可被精确运动学追踪,同时决定手的整体构型并定位手指至可达抓取位。为确保交互中手腕定位可靠,引入手腕专属重置约束与奖励优先级机制。实验表明,该方法在多种手部形态下均实现不依赖手指姿态的操控重定向,性能不低于甚至超过依赖完整手姿监督的方法。

原文摘要 · Abstract (English)

Retargeting human object interaction demonstrations to physics based simulation requires reproducing not only body motion but also the object motion and contacts that make manipulation succeed. However, position only hand trajectories do not specify the contact forces needed to manipulate objects, and directly tracking them can overconstrain contact rich finger behavior. We introduce WristMimic, a wrist guided whole body control framework that explicitly separates contact free body motion from contact rich hand manipulation. The contact free body and wrist are guided by kinematic pose targets, whereas the fingers are not directly supervised by human hand pose. Instead, they learn grasping and manipulation behaviors from object tracking and contact outcomes. Our key insight is that the wrist is the natural gate between these two regimes. It is largely free from contact and can be tracked kinematically, yet it determines the global hand configuration and places the fingers within reachable grasp affordances. To ensure reliable wrist placement during interaction, we introduce wrist specific reset constraints and reward prioritization. Experiments show that WristMimic matches or surpasses methods using full finger pose supervision while enabling finger agnostic retargeting across diverse hand embodiments.

人形机器人运动控制抓取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。