arXiv:2509.14055cs.CV2025-09被引 75

一键实现角色动画与替换,动作表情还原度高。

Wan-Animate: Unified Character Animation and Replacement with Holistic Replication

  • 用骨骼信号和隐式面部特征控制角色动作与表情。
  • 生成视频保真度高,角色替换后光影色彩无缝融合。
  • 适合影视剪辑、虚拟角色创作等场景使用。

我们提出Wan-Animate,一个统一的角色动画与替换框架。给定一张角色图像和参考视频,该方法可精确复刻视频中角色的表情与动作,生成高保真角色视频;或将其动画角色无缝嵌入参考视频,替换原角色,同时保持场景光照与色调一致。该框架基于Wan模型,通过改进输入范式区分参考条件与生成区域,将多任务统一为符号化表示。采用空间对齐的骨架信号复现身体动作,从源图像提取隐式面部特征重演表情,实现高可控性与表现力。为提升替换时的环境融合效果,设计了辅助的Relighting LoRA模块,保持角色外观一致性的同时适配环境光照与色彩。实验表明,Wan-Animate达到当前最优性能。我们承诺开源模型权重与源代码。

原文摘要 · Abstract (English)

We introduce Wan-Animate, a unified framework for character animation and replacement. Given a character image and a reference video, Wan-Animate can animate the character by precisely replicating the expressions and movements of the character in the video to generate high-fidelity character videos. Alternatively, it can integrate the animated character into the reference video to replace the original character, replicating the scene's lighting and color tone to achieve seamless environmental integration. Wan-Animate is built upon the Wan model. To adapt it for character animation tasks, we employ a modified input paradigm to differentiate between reference conditions and regions for generation. This design unifies multiple tasks into a common symbolic representation. We use spatially-aligned skeleton signals to replicate body motion and implicit facial features extracted from source images to reenact expressions, enabling the generation of character videos with high controllability and expressiveness. Furthermore, to enhance environmental integration during character replacement, we develop an auxiliary Relighting LoRA. This module preserves the character's appearance consistency while applying the appropriate environmental lighting and color tone. Experimental results demonstrate that Wan-Animate achieves state-of-the-art performance. We are committed to open-sourcing the model weights and its source code.

角色动画视频替换光影融合生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。