分部位建模运动相位,实现可编辑的精细动作插值。
Towards Synthesized and Editable Motion In-Betweening Through Part-Wise Phase Representation
- 按身体部位建模运动相位,捕捉局部风格特征。
- 支持独立调节肢体动作,保持整体动作连贯性。
- 适合需要精细控制动画动作的影视与游戏开发。
风格化动作插值在计算机动画和游戏中至关重要。现有方法通常以全身动作为单位编码风格,忽视了各身体部位的独立表示,导致动作灵活性受限,难以独立调整特定肢体风格。为此,我们提出一种新型框架,从身体部位层面建模运动风格,显著提升插值动作的多样性和可控性。通过周期性自编码器自动提取各部位运动相位,捕捉独特的局部风格特征,并结合运动流形学习与跨图像-动作域的条件生成技术,有效解耦运动源与合成控制。该框架使运动源能生成多种风格的高质量动作,且提取的运动与风格特征可用于后续任务的受控合成。全面评估表明,本方法在速度、泛化能力及长序列生成方面均表现优异。
原文摘要 · Abstract (English)
Styled motion in-betweening is crucial for computer animation and gaming. However, existing methods typically encode motion styles by modeling whole-body motions, often overlooking the representation of individual body parts. This limitation reduces the flexibility of infilled motion, particularly in adjusting the motion styles of specific limbs independently. To overcome this challenge, we propose a novel framework that models motion styles at the body-part level, enhancing both the diversity and controllability of infilled motions. Our approach enables more nuanced and expressive animations by allowing precise modifications to individual limb motions while maintaining overall motion coherence. Leveraging phase-related insights, our framework employs periodic autoencoders to automatically extract the phase of each body part, capturing distinctive local style features. Additionally, we effectively decouple the motion source from synthesis control by integrating motion manifold learning and conditional generation techniques from both image and motion domains. This allows the motion source to generate high-quality motions across various styles, with extracted motion and style features readily available for controlled synthesis in subsequent tasks. Comprehensive evaluations demonstrate that our method achieves superior speed, robust generalization, and effective generation of extended motion sequences.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。