用多域嵌入实现机器人实时拟态,无需重定向即可模仿复杂动作。
Multi-Domain Motion Embedding: Expressive Real-Time Mimicry for Legged Robots
- 基于小波编码与概率嵌入并行,统一表达周期性与非周期性运动特征
- 仅需少量输入即生成丰富运动表示,跨风格和体型泛化能力更强
- 零样本部署实现实时新动作复现,适合需要快速适应的机器人应用
有效的运动表征对实现机器人实时拟态表达行为至关重要,但现有运动控制器常忽略运动中的内在模式。以往表征学习方法未能同时捕捉人类与动物运动中的结构化周期性特征与非规则变化。为此,我们提出多域运动嵌入(MDME),采用小波编码器与概率嵌入并行架构,统一嵌入结构化与非结构化特征。该方法仅需少量输入即可生成丰富的参考运动表示,显著提升在多样化运动风格与形态间的泛化能力。我们在无重定向的实时运动拟态任务中评估MDME,通过条件化机器人控制策略于学习到的嵌入,准确再现了人形与四足平台上的复杂轨迹。对比实验表明,MDME在重建保真度与未见动作泛化性上优于现有方法。此外,我们验证了MDME可通过零样本部署实时复现新运动风格,无需任务特定调优或在线重定向。这些结果表明,MDME是可扩展、结构感知的实时机器人拟态通用基础。
原文摘要 · Abstract (English)
Effective motion representation is crucial for enabling robots to imitate expressive behaviors in real time, yet existing motion controllers often ignore inherent patterns in motion. Previous efforts in representation learning do not attempt to jointly capture structured periodic patterns and irregular variations in human and animal movement. To address this, we present Multi-Domain Motion Embedding (MDME), a motion representation that unifies the embedding of structured and unstructured features using a wavelet-based encoder and a probabilistic embedding in parallel. This produces a rich representation of reference motions from a minimal input set, enabling improved generalization across diverse motion styles and morphologies. We evaluate MDME on retargeting-free real-time motion imitation by conditioning robot control policies on the learned embeddings, demonstrating accurate reproduction of complex trajectories on both humanoid and quadruped platforms. Our comparative studies confirm that MDME outperforms prior approaches in reconstruction fidelity and generalizability to unseen motions. Furthermore, we demonstrate that MDME can reproduce novel motion styles in real-time through zero-shot deployment, eliminating the need for task-specific tuning or online retargeting. These results position MDME as a generalizable and structure-aware foundation for scalable real-time robot imitation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。