用稀疏关键关节信号实现灵活可控的角色动画生成
Motion Synthesis with Sparse and Flexible Keyjoint Control
- 分阶段扩散模型先生成关键关节运动,再扩展为全身动作
- 支持无帧时间标注的灵活控制,适配多种目标驱动场景
- 可处理末端位置、功能约束等多样控制信号,提升创作效率
角色动画创作耗时费力,需动画师在时空上精细调整。以往可控动作生成依赖密集的时空预设(如每帧精确的骨盆轨迹),限制了实际应用。为此,我们提出一种实用的可控动作合成框架,支持稀疏且灵活的关键关节控制。方法采用分解式扩散架构:先从稀疏控制信号生成关键关节运动,再基于完整的关键关节轨迹合成全身动作。低维关键关节运动可灵活适配多种控制类型,如末端执行器位置以实现多目标驱动动作合成,或对部分关键关节施加功能约束。此外,引入时间无关的控制形式,无需逐帧时间标注,增强控制灵活性。第二阶段共享模块可生成符合任务要求的自然全身动作。在多个数据集与场景中验证了稀疏灵活关键关节控制的有效性。
原文摘要 · Abstract (English)
Creating expressive character animations is labor-intensive, requiring intricate manual adjustment of animators across space and time. Previous works on controllable motion generation often rely on a predefined set of dense spatio-temporal specifications (e.g., dense pelvis trajectories with exact per-frame timing), limiting practicality for animators. To process high-level intent and intuitive control in diverse scenarios, we propose a practical controllable motions synthesis framework that respects sparse and flexible keyjoint signals. Our approach employs a decomposed diffusion-based motion synthesis framework that first synthesizes keyjoint movements from sparse input control signals and then synthesizes full-body motion based on the completed keyjoint trajectories. The low-dimensional keyjoint movements can easily adapt to various control signal types, such as end-effector position for diverse goal-driven motion synthesis, or incorporate functional constraints on a subset of keyjoints. Additionally, we introduce a time-agnostic control formulation, eliminating the need for frame-specific timing annotations and enhancing control flexibility. Then, the shared second stage can synthesize a natural whole-body motion that precisely satisfies the task requirement from dense keyjoint movements. We demonstrate the effectiveness of sparse and flexible keyjoint control through comprehensive experiments on diverse datasets and scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。