arXiv:2511.19320cs.CV2025-11被引 9

让人物动画保持初始形象,同时精准控制动作。

SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservation

  • 通过条件协调机制平衡形象与动作控制矛盾。
  • 生成兼容参考图的自适应动作表示,减少失真。
  • 分阶段训练提升运动连贯性,资源消耗更低。

在人物图像动画中,保持首帧身份特征并实现精确动作控制是核心挑战。主流的参考到视频(R2V)范式在图像到动作绑定过程中忽略真实场景中的时空错位,导致身份漂移和视觉伪影。我们提出SteadyDancer,一种基于图像到视频(I2V)范式的框架,首次实现鲁棒的首帧保真动画。首先,设计条件协调机制,调和身份与动作控制间的冲突;其次,引入协同姿态调制模块,生成与参考图高度兼容的自适应姿态表征;最后,采用分阶段解耦目标训练流程,逐层优化运动保真度、视觉质量与时间连贯性。实验表明,SteadyDancer在外观保真度与动作控制上均达当前最优水平,且所需训练资源显著少于同类方法。模型已公开发布于 <a href="https://mcg-nju.github.io/steadydancer-web">https://mcg-nju.github.io/steadydancer-web</a>。

原文摘要 · Abstract (English)

Preserving first-frame identity while ensuring precise motion control is a fundamental challenge in human image animation. The Image-to-Motion Binding process of the dominant Reference-to-Video (R2V) paradigm overlooks critical spatio-temporal misalignments common in real-world applications, leading to failures such as identity drift and visual artifacts. We introduce SteadyDancer, an Image-to-Video (I2V) paradigm-based framework that achieves harmonized and coherent animation and is the first to ensure first-frame preservation robustly. Firstly, we propose a Condition-Reconciliation Mechanism to harmonize the two conflicting conditions, enabling precise control without sacrificing fidelity. Secondly, we design Synergistic Pose Modulation Modules to generate an adaptive and coherent pose representation that is highly compatible with the reference image. Finally, we employ a Staged Decoupled-Objective Training Pipeline that hierarchically optimizes the model for motion fidelity, visual quality, and temporal coherence. Experiments demonstrate that SteadyDancer achieves state-of-the-art performance in both appearance fidelity and motion control, while requiring significantly fewer training resources than comparable methods. The model has been publicly released at \url{https://mcg-nju.github.io/steadydancer-web}.

人物动画身份保持动作控制图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。