无需配对数据,实现动作风格迁移与重定向。
D-LORD for Motion Stylization
- 双隐变量优化分离动作类属性与内容
- 跨数据集验证,支持多样化动作生成
- 适合动画、游戏、虚拟人动作设计
本文提出D-LORD(双隐变量优化用于表征解耦)框架,用于动作风格化(动作风格迁移与动作重定向)。该框架通过数据驱动的隐变量优化,将动作序列中的类别信息(如个人身份或情绪)与内容信息(如行走、跳跃等通用动作)解耦。其中,类别指个体特有风格,内容指动作本身语义。其核心优势在于无需配对动作数据即可完成风格迁移,仅需在隐空间优化中使用类别和内容标签。通过解耦表示,利用自适应实例归一化实现风格转换。框架具备强泛化能力,可处理多种类别与内容组合,并生成多样化的动作序列。实验在三个数据集上验证:CMU XIA用于动作风格迁移,MHAD与RRIS Ability用于动作重定向。D-LORD是首个统一的通用框架,为该领域提供新范式。
原文摘要 · Abstract (English)
This paper introduces a novel framework named D-LORD (Double Latent Optimization for Representation Disentanglement), which is designed for motion stylization (motion style transfer and motion retargeting). The primary objective of this framework is to separate the class and content information from a given motion sequence using a data-driven latent optimization approach. Here, class refers to person-specific style, such as a particular emotion or an individual's identity, while content relates to the style-agnostic aspect of an action, such as walking or jumping, as universally understood concepts. The key advantage of D-LORD is its ability to perform style transfer without needing paired motion data. Instead, it utilizes class and content labels during the latent optimization process. By disentangling the representation, the framework enables the transformation of one motion sequences style to another's style using Adaptive Instance Normalization. The proposed D-LORD framework is designed with a focus on generalization, allowing it to handle different class and content labels for various applications. Additionally, it can generate diverse motion sequences when specific class and content labels are provided. The framework's efficacy is demonstrated through experimentation on three datasets: the CMU XIA dataset for motion style transfer, the MHAD dataset, and the RRIS Ability dataset for motion retargeting. Notably, this paper presents the first generalized framework for motion style transfer and motion retargeting, showcasing its potential contributions in this area.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。