让舞蹈生成更真实,避免踩空和变形
PAMD: Plausibility-Aware Motion Diffusion Model for Long Dance Generation
- 用神经距离场约束动作空间,确保动作符合人体物理规律
- 结合音乐特征与站姿引导,生成更连贯的长序列舞蹈
- 专门修复脚部与地面接触问题,提升复杂动作的自然度
计算舞蹈生成在艺术、人机交互、虚拟现实和数字娱乐中至关重要,尤其需要生成连贯且富有表现力的长舞蹈序列。基于扩散模型的音乐到舞蹈生成已取得进展,但现有方法仍难以生成符合物理真实的动作。为此,我们提出普适性感知动作扩散模型(PAMD),可生成既与音乐对齐又物理合理的舞蹈。其核心是普适性动作约束(PMC),利用神经距离场(NDFs)建模真实姿态流形,并引导生成动作趋向物理可行的姿态空间。为增强生成过程中的引导效果,引入先验动作引导(PMG),以站立姿态作为辅助条件,结合音乐特征进行生成。为进一步提升复杂动作的真实感,提出足地接触动作优化模块(MRFC),通过弥合线性关节位置空间的优化目标与非线性旋转空间数据表示之间的差距,解决足部滑移问题。大量实验表明,PAMD显著提升了音乐对齐性,并增强了生成动作的物理合理性。
原文摘要 · Abstract (English)
Computational dance generation is crucial in many areas, such as art, human-computer interaction, virtual reality, and digital entertainment, particularly for generating coherent and expressive long dance sequences. Diffusion-based music-to-dance generation has made significant progress, yet existing methods still struggle to produce physically plausible motions. To address this, we propose Plausibility-Aware Motion Diffusion (PAMD), a framework for generating dances that are both musically aligned and physically realistic. The core of PAMD lies in the Plausible Motion Constraint (PMC), which leverages Neural Distance Fields (NDFs) to model the actual pose manifold and guide generated motions toward a physically valid pose manifold. To provide more effective guidance during generation, we incorporate Prior Motion Guidance (PMG), which uses standing poses as auxiliary conditions alongside music features. To further enhance realism for complex movements, we introduce the Motion Refinement with Foot-ground Contact (MRFC) module, which addresses foot-skating artifacts by bridging the gap between the optimization objective in linear joint position space and the data representation in nonlinear rotation space. Extensive experiments show that PAMD significantly improves musical alignment and enhances the physical plausibility of generated motions. This project page is available at: https://mucunzhuzhu.github.io/PAMD-page/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。