arXiv:2602.16712cs.RO2026-02中稿 · RSS 2026被引 12

统一多样机械手的表示与动作空间,实现跨手型零样本泛化抓取。

One Hand to Rule Them All: Canonical Representations for Unified Dexterous Manipulation

  • 构建参数化通用表示与标准URDF格式,统一不同结构机械手。
  • 在81.9%成功率下实现对未见三指手的零样本抓取。
  • 适用于多种机械手的可迁移抓取策略,适合具身智能研究者。

当前灵巧操作策略多依赖固定手型设计,严重限制了对新形态机械手的泛化能力。为此,我们提出一种参数化通用表示,统一多种灵巧手架构。该表示包含统一参数空间与标准URDF格式,具备三大优势:1)参数空间捕获关键形态与运动学差异,支持学习算法有效条件化;2)可在参数空间中学习结构化潜在流形,形态插值平滑且物理合理;3)标准动作空间保留原始动力学与功能特性,支持高效可靠的跨手型策略学习。通过大量实验验证:基于统一表示训练的VAE生成紧凑语义嵌入,条件化于通用表示的抓取策略可跨手型泛化。仿真与真实世界任务中,对未见形态(如三指LEAP手)实现81.9%零样本成功率,证明框架成功统一多样手型的表征与动作空间,为通用灵巧操作提供可扩展基础。

原文摘要 · Abstract (English)

Dexterous manipulation policies today largely assume fixed hand designs, severely restricting their generalization to new embodiments with varied kinematic and structural layouts. To overcome this limitation, we introduce a parameterized canonical representation that unifies a broad spectrum of dexterous hand architectures. It comprises a unified parameter space and a canonical URDF format, offering three key advantages. 1) The parameter space captures essential morphological and kinematic variations for effective conditioning in learning algorithms. 2) A structured latent manifold can be learned over our space, where interpolations between embodiments yield smooth and physically meaningful morphology transitions. 3) The canonical URDF standardizes the action space while preserving dynamic and functional properties of the original URDFs, enabling efficient and reliable cross-embodiment policy learning. We validate these advantages through extensive analysis and experiments, including grasp policy replay, VAE latent encoding, and cross-embodiment zero-shot transfer. Specifically, we train a VAE on the unified representation to obtain a compact, semantically rich latent embedding, and develop a grasping policy conditioned on the canonical representation that generalizes across dexterous hands. We demonstrate, through simulation and real-world tasks on unseen morphologies (e.g., 81.9% zero-shot success rate on 3-finger LEAP Hand), that our framework unifies both the representational and action spaces of structurally diverse hands, providing a scalable foundation for cross-hand learning toward universal dexterous manipulation. Project Page: https://zhenyuwei2003.github.io/OHRA/

灵巧操作通用表示零样本迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。