解决长动作序列生成中片段衔接不自然的问题
Deep Compositional Phase Diffusion for Long Motion Sequence Generation
- 在频域潜空间中分步注入语义与过渡相位信息
- 生成的复合动作序列语义对齐且片段间过渡平滑
- 支持动作插值,适合影视动画等场景应用
近期动作生成研究在单一语义动作生成方面取得显著进展,但在生成包含多个语义动作片段的复合序列时,常因片段间过渡边界处运动动态连续性丢失,导致动作突兀、出现异常。为此,本文提出组合相位扩散(Compositional Phase Diffusion),通过语义相位扩散模块(SPDM)与过渡相位扩散模块(TPDM),在预训练的动作中心相位自编码器(ACT-PAE)构建的潜运动频域中,逐步融入相邻动作片段的语义引导与相位细节。该机制使模型能从变长动作片段中学习语义关键与过渡感知的相位信息。实验表明,所提框架在生成语义对齐的复合动作序列时表现优异,有效保持了前后动作片段间的相位连续性。此外,通过固定输入动作序列的相位参数,可实现动作插值任务,展现出扩展至多种应用场景的潜力。代码已开源:https://github.com/asdryau/TransPhase。
原文摘要 · Abstract (English)
Recent research on motion generation has shown significant progress in generating semantically aligned motion with singular semantics. However, when employing these models to create composite sequences containing multiple semantically generated motion clips, they often struggle to preserve the continuity of motion dynamics at the transition boundaries between clips, resulting in awkward transitions and abrupt artifacts. To address these challenges, we present Compositional Phase Diffusion, which leverages the Semantic Phase Diffusion Module (SPDM) and Transitional Phase Diffusion Module (TPDM) to progressively incorporate semantic guidance and phase details from adjacent motion clips into the diffusion process. Specifically, SPDM and TPDM operate within the latent motion frequency domain established by the pre-trained Action-Centric Motion Phase Autoencoder (ACT-PAE). This allows them to learn semantically important and transition-aware phase information from variable-length motion clips during training. Experimental results demonstrate the competitive performance of our proposed framework in generating compositional motion sequences that align semantically with the input conditions, while preserving phase transitional continuity between preceding and succeeding motion clips. Additionally, motion inbetweening task is made possible by keeping the phase parameter of the input motion sequences fixed throughout the diffusion process, showcasing the potential for extending the proposed framework to accommodate various application scenarios. Codes are available at https://github.com/asdryau/TransPhase.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。