arXiv:2606.16272cs.RO2026-06被引 1

让机器人手复现人类手势时,精准保持手物接触结构。

TopoRetarget: Interaction-Preserving Retargeting for Dexterous Manipulation

论文配图:TopoRetarget: Interaction-Preserving Retargeting for Dexterous Manipulation
图 1 · 摘自论文原文
  • 构建稀疏交互图,用拉普拉斯变形优化姿态匹配
  • 在接触精度和对齐度上超越所有基线方法
  • 适合需要高保真手物交互的机器人灵巧操作任务

人类手部-物体示范为训练灵巧操作强化学习策略提供了密集参考运动。但要将这些示范用于策略学习,必须保持手部姿态和任务相关的手物接触结构,否则接触与可行性伪影会损害下游强化学习策略性能。我们提出TopoRetarget,一种保留交互关系的重定向框架,使用单一参数集适应多样重定向场景,同时保持任务相关手物交互,并将人类示范适配至灵巧机器人手。该方法在手部与物体关键点上构建稀疏交互图,通过距离加权拉普拉斯变形、方向一致性、运动学约束与穿透处理进行优化。评估显示,生成的参考动作显著提升交互保真度与策略学习效果:在ContactPose数据集上,接触精度与对齐度均优于所有基线;在笔旋转任务中,训练成功率比现有方法提高40.6个百分点;并成功实现零样本迁移至Wuji Hand硬件完成立方体翻转与笔旋转任务。

原文摘要 · Abstract (English)

Human hand-object demonstrations provide dense reference motions for training dexterous manipulation reinforcement learning (RL) policies through reference tracking. However, to use such demonstrations for RL policy learning, retargeting must preserve hand pose and task-relevant hand-object contact structure. Otherwise, contact and feasibility artifacts can degrade downstream RL policy performance. We introduce TopoRetarget, an interaction-preserving retargeting framework that uses a single set of parameters across diverse retargeting conditions while maintaining task-relevant hand-object interaction and adapting human demonstrations to dexterous robot hands. The method constructs a sparse interaction graph over hand and object keypoints and optimizes distance-weighted Laplacian deformation with directional consistency, kinematic constraints, and penetration handling. Evaluations show that the generated references improve both interaction fidelity and policy learning: TopoRetarget achieves the best contact precision and alignment over all baselines on the ContactPose Dataset, improves Pen-Spin training success by 40.6 percentage points over the existing baseline methods, and enables zero-shot transfer to Wuji Hand hardware on cube reorientation and pen spinning.

灵巧操作手物交互重定向强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。