无需配对数据,让不同体型角色自由迁移动作。
MoReFlow: Motion Retargeting Learning through Unsupervised Flow Matching
- 用VQ-VAE提取角色动作的紧凑编码,再通过流匹配对齐不同角色的编码空间。
- 训练后可实现跨角色动作迁移,且在多样角色和任务上生成更真实、可控的动作。
- 适合动画风格保留或机器人任务对齐等需要灵活动作迁移的场景。
动作重定向为不同体型的角色和机器人提供更丰富的动作数据支持。以往方法依赖手工约束或成对动作数据,适用范围受限于人形角色或如行走等有限行为,且通常假设固定的重定向模式,忽略了动画中的风格保持或机器人中的任务空间对齐等特定目标。本文提出MoReFlow:基于流匹配的无监督动作重定向框架,通过学习不同角色动作嵌入空间间的对应关系实现重定向。方法分为两阶段:首先使用VQ-VAE为每个角色训练分段动作嵌入,获得紧凑的潜在表示;其次采用条件耦合的流匹配对齐跨角色潜在空间,同时学习条件与无条件匹配,实现鲁棒且灵活的重定向。训练完成后,MoReFlow可在不依赖配对数据的情况下实现灵活且可逆的重定向。实验表明,该方法在多种角色和任务中均生成高质量动作,相比基线在可控性、泛化性和动作真实性方面均有提升。
原文摘要 · Abstract (English)
Motion retargeting holds a premise of offering a larger set of motion data for characters and robots with different morphologies. Many prior works have approached this problem via either handcrafted constraints or paired motion datasets, limiting their applicability to humanoid characters or narrow behaviors such as locomotion. Moreover, they often assume a fixed notion of retargeting, overlooking domain-specific objectives like style preservation in animation or task-space alignment in robotics. In this work, we propose MoReFlow, Motion Retargeting via Flow Matching, an unsupervised framework that learns correspondences between characters' motion embedding spaces. Our method consists of two stages. First, we train tokenized motion embeddings for each character using a VQ-VAE, yielding compact latent representations. Then, we employ flow matching with conditional coupling to align the latent spaces across characters, which simultaneously learns conditioned and unconditioned matching to achieve robust but flexible retargeting. Once trained, MoReFlow enables flexible and reversible retargeting without requiring paired data. Experiments demonstrate that MoReFlow produces high-quality motions across diverse characters and tasks, offering improved controllability, generalization, and motion realism compared to the baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。