arXiv:2503.08622cs.RO2025-03被引 5

用人类示范指导机器人跨形态操作,生成流畅动作轨迹。

Cross-Embodiment Robotic Manipulation Synthesis via Guided Demonstrations through CycleVAE and Human Behavior Transformer

  • 通过循环变分自编码器对齐不同机器人形态的运动潜空间
  • 利用因果人类行为变换器学习专家示范中的内在运动规律
  • 无需配对数据即可实现复杂任务的跨形态动作合成,适合具身智能研究者

复杂任务下的跨形态机器人操作合成面临挑战,主要源于配对跨形态数据集稀缺及复杂控制器设计困难。受通过引导式人类专家示范进行机器人学习的启发,本文提出一种基于循环变分自编码器(CycleVAE)与人类行为变换器的新型跨形态机器人操作算法。首先,采用无监督循环变分自编码器结合双向子空间对齐算法,实现跨形态运动序列的潜在空间对齐;其次,设计因果人类行为变换器以学习人类专家示范中的内在运动动力学。测试阶段,利用所提变换器生成人类示范,并通过循环变分自编码器对齐,完成最终的人机协同操作合成。通过使用灵巧机械臂在真实场景中进行大量实验验证,结果成功生成复杂任务下的平滑轨迹,优于以往基于学习的机器人运动规划算法。该成果对实现无监督跨形态对齐及未来自主机器人设计具有重要意义。完整实验视频见:https://sites.google.com/view/humanrobots/home。

原文摘要 · Abstract (English)

Cross-embodiment robotic manipulation synthesis for complicated tasks is challenging, partially due to the scarcity of paired cross-embodiment datasets and the impediment of designing intricate controllers. Inspired by robotic learning via guided human expert demonstration, we here propose a novel cross-embodiment robotic manipulation algorithm via CycleVAE and human behavior transformer. First, we utilize unsupervised CycleVAE together with a bidirectional subspace alignment algorithm to align latent motion sequences between cross-embodiments. Second, we propose a casual human behavior transformer design to learn the intrinsic motion dynamics of human expert demonstrations. During the test case, we leverage the proposed transformer for the human expert demonstration generation, which will be aligned using CycleVAE for the final human-robotic manipulation synthesis. We validated our proposed algorithm through extensive experiments using a dexterous robotic manipulator with the robotic hand. Our results successfully generate smooth trajectories across intricate tasks, outperforming prior learning-based robotic motion planning algorithms. These results have implications for performing unsupervised cross-embodiment alignment and future autonomous robotics design. Complete video demonstrations of our experiments can be found in https://sites.google.com/view/humanrobots/home.

机器人操作跨形态行为建模生成合成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。