arXiv:2508.07945cs.RO2025-08被引 5

用主成分分析统一表示不同机械手姿态,提升操控学习效率。

PCHands: PCA-based Hand Pose Synergy Representation on Manipulators with N-DoF

  • 基于锚点定义统一描述格式,提取可变长度的隐空间表征。
  • 主成分在不同结构机械手上具通用性,显著提升强化学习效率。
  • 支持跨机械手示范学习,适用于真实世界2指与4指机械手实验。

针对不同形态机械手间灵巧操作的通用表征学习问题,本文提出PCHands方法,从多类机械手(从双指夹持器到五指仿人手)中提取手部姿态协同。通过基于锚点的统一描述格式,实现机械手配置的可变长度隐空间表征,并对齐所有机械手末端执行器坐标系。结果表明,该隐空间表征中提取的主成分具有跨结构、跨自由度的通用性。为验证效果,将该紧凑表征用于强化学习策略的观测与动作空间编码,相比关节空间基线,学习效率与一致性均显著提升。此外,当演示来自不同机械手时,PCHands仍能保持鲁棒性能。真实世界实验涵盖双指夹持器与四指仿人手。代码与补充材料见 https://hsp-iit.github.io/PCHands/。

原文摘要 · Abstract (English)

We consider the problem of learning a common representation for dexterous manipulation across manipulators of different morphologies. To this end, we propose PCHands, a novel approach for extracting hand postural synergies from a large set of manipulators. We define a simplified and unified description format based on anchor positions for manipulators ranging from 2-finger grippers to 5-finger anthropomorphic hands. This enables learning a variable-length latent representation of the manipulator configuration and the alignment of the end-effector frame of all manipulators. We show that it is possible to extract principal components from this latent representation that is universal across manipulators of different structures and degrees of freedom. To evaluate PCHands, we use this compact representation to encode observation and action spaces of control policies for dexterous manipulation tasks learned with RL. In terms of learning efficiency and consistency, the proposed representation outperforms a baseline that learns the same tasks in joint space. We additionally show that PCHands performs robustly in RL from demonstration, when demonstrations are provided from a different manipulator. We further support our results with real-world experiments that involve a 2-finger gripper and a 4-finger anthropomorphic hand. Code and additional material are available at https://hsp-iit.github.io/PCHands/.

机械手姿态协同强化学习表征学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。