用少量样本实现动作风格迁移,让生成动作既符合文本又保持自然
Dance Like a Chicken: Low-Rank Stylization for Human Motion Diffusion
- 通过低秩适配调整生成先验,实现风格迁移
- 仅需少量参考样本即可生成高质量风格化动作
- 支持风格混合与动作编辑,适合动画/游戏开发
文本到动作生成模型涵盖多种3D人体动作,但在捕捉细微风格特征(如“鸡”式动作)方面表现不佳。由于风格特定数据稀缺,现有方法通常将生成先验拉向参考风格,导致生成结果分布外、质量低下。本文提出LoRA-MDM,一种轻量级动作风格化框架,能在复杂动作上泛化并保持可编辑性。核心思路是:在不破坏整体分布的前提下,通过少量样本适配生成先验以包含目标风格,而非在生成时逐个修改动作。该方法通过低秩适配在语义上有意义地改变动作流形,即使对于参考样本中未出现的动作也能实现真实风格注入。同时保留分布结构,支持风格融合与动作编辑。与现有先进方法相比,LoRA-MDM在文本契合度与风格一致性间取得良好平衡。
原文摘要 · Abstract (English)
Text-to-motion generative models span a wide range of 3D human actions but struggle with nuanced stylistic attributes such as a "Chicken" style. Due to the scarcity of style-specific data, existing approaches pull the generative prior towards a reference style, which often results in out-of-distribution low quality generations. In this work, we introduce LoRA-MDM, a lightweight framework for motion stylization that generalizes to complex actions while maintaining editability. Our key insight is that adapting the generative prior to include the style, while preserving its overall distribution, is more effective than modifying each individual motion during generation. Building on this idea, LoRA-MDM learns to adapt the prior to include the reference style using only a few samples. The style can then be used in the context of different textual prompts for generation. The low-rank adaptation shifts the motion manifold in a semantically meaningful way, enabling realistic style infusion even for actions not present in the reference samples. Moreover, preserving the distribution structure enables advanced operations such as style blending and motion editing. We compare LoRA-MDM to state-of-the-art stylized motion generation methods and demonstrate a favorable balance between text fidelity and style consistency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。