arXiv:2601.15419cs.RO2026-01被引 4

用统一潜空间让不同机器人模仿人类动作,无需重新训练。

Learning a Unified Latent Space for Cross-Embodiment Robot Control

  • 通过对比学习构建分部位运动的解耦潜空间,实现跨形态动作迁移。
  • 仅用人类数据训练的策略可直接部署在多种人形机器人上,零适配。
  • 新增机器人只需加轻量嵌入层,潜空间策略即可复用,适合多平台部署。

我们提出一种可扩展的跨体感人形机器人控制框架,通过学习一个共享潜表示,统一人类与多种人形平台(包括单臂、双臂和腿式机器人)的运动。方法分两阶段:首先利用对比学习构建解耦潜空间,捕捉各身体部位的局部运动模式,实现跨异构机器人的精准灵活动作重定向;针对关键部位(如手臂),引入结合关节旋转与末端位置的定制化相似性度量以增强体感对齐。随后,在该潜空间中仅使用人类数据训练目标条件控制策略,基于条件变分自编码器预测由目标方向引导的潜空间位移。实验表明,训练好的策略可直接部署于多个机器人而无需调整。此外,通过仅学习轻量级机器人特定嵌入层,即可高效将新机器人加入潜空间,且所学策略可直接应用。结果验证了该方法在多种人形平台上的鲁棒、可扩展与体感无关的控制能力。

原文摘要 · Abstract (English)

We present a scalable framework for cross-embodiment humanoid robot control by learning a shared latent representation that unifies motion across humans and diverse humanoid platforms, including single-arm, dual-arm, and legged humanoid robots. Our method proceeds in two stages: first, we construct a decoupled latent space that captures localized motion patterns across different body parts using contrastive learning, enabling accurate and flexible motion retargeting even across robots with diverse morphologies. To enhance alignment between embodiments, we introduce tailored similarity metrics that combine joint rotation and end-effector positioning for critical segments, such as arms. Then, we train a goal-conditioned control policy directly within this latent space using only human data. Leveraging a conditional variational autoencoder, our policy learns to predict latent space displacements guided by intended goal directions. We show that the trained policy can be directly deployed on multiple robots without any adaptation. Furthermore, our method supports the efficient addition of new robots to the latent space by learning only a lightweight, robot-specific embedding layer. The learned latent policies can also be directly applied to the new robots. Experimental results demonstrate that our approach enables robust, scalable, and embodiment-agnostic robot control across a wide range of humanoid platforms.

机器人控制潜空间跨体感动作迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。