arXiv:2503.15851cs.CV2025-03CVPR被引 11

仅用一张图生成可动画化头像,无需大量训练数据。

Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusion

  • 分两阶段渐进优化:先固定表情学侧面视角,再固定视角学表情变化。
  • 生成的4D头像在保真度、动画质量和渲染速度上均优于现有方法。
  • 适合需要快速创建逼真可动头像的开发者与创作者使用。

可动画头像生成通常需要大量训练数据。为降低数据需求,自然思路是利用无需训练的静态头像生成方法,如基于分数蒸馏采样的预训练扩散模型,通过与扩散模型伪真值输出对齐来生成头像。然而,直接从视频扩散模型蒸馏4D头像常因生成视频的空间与时间不一致导致结果过度平滑。为此,我们提出Zero-1-to-A,一种利用视频扩散模型构建空间与时间一致性数据集的鲁棒方法。该方法迭代构建视频数据集并渐进式优化可动画头像,确保学习过程中的质量持续提升。整个过程分为两个阶段:(1) 空间一致性学习,固定表情,从正面到侧面对齐;(2) 时间一致性学习,固定视角,从自然到夸张表情学习,实现从简单到复杂的4D头像生成。大量实验表明,与现有基于扩散的方法相比,Zero-1-to-A在保真度、动画质量与渲染速度上均有提升,为真实感头像生成提供有效方案。代码已公开于:https://github.com/ZhenglinZhou/Zero-1-to-A。

原文摘要 · Abstract (English)

Animatable head avatar generation typically requires extensive data for training. To reduce the data requirements, a natural solution is to leverage existing data-free static avatar generation methods, such as pre-trained diffusion models with score distillation sampling (SDS), which align avatars with pseudo ground-truth outputs from the diffusion model. However, directly distilling 4D avatars from video diffusion often leads to over-smooth results due to spatial and temporal inconsistencies in the generated video. To address this issue, we propose Zero-1-to-A, a robust method that synthesizes a spatial and temporal consistency dataset for 4D avatar reconstruction using the video diffusion model. Specifically, Zero-1-to-A iteratively constructs video datasets and optimizes animatable avatars in a progressive manner, ensuring that avatar quality increases smoothly and consistently throughout the learning process. This progressive learning involves two stages: (1) Spatial Consistency Learning fixes expressions and learns from front-to-side views, and (2) Temporal Consistency Learning fixes views and learns from relaxed to exaggerated expressions, generating 4D avatars in a simple-to-complex manner. Extensive experiments demonstrate that Zero-1-to-A improves fidelity, animation quality, and rendering speed compared to existing diffusion-based methods, providing a solution for lifelike avatar creation. Code is publicly available at: https://github.com/ZhenglinZhou/Zero-1-to-A.

头像生成视频扩散零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。