仅用一张图生成高保真3D头像,支持真实动态表情和视角。
S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image

- 用扩散模型生成初始3D高斯点云,保证细节质量。
- 结合FLAME模型对齐与绑定,实现30fps实时渲染。
- 适合虚拟现实、数字人等需要高质量头像的场景。
我们提出S-Avatar,一种仅需单张图像即可生成逼真3D头像的新方法,通过基于扩散模型的3D高斯点云生成模块与3D高斯溅射(3DGS)动画策略实现。尽管单图头像重建对虚拟现实应用至关重要,现有方法常在未见视角下丧失3D一致性。S-Avatar采用三阶段流程:首先,利用基于扩散的高斯点云生成模块直接从单图合成高分辨率3DGS;其次,通过优化参数与空间变换将参数化头像模型FLAME与生成的3DGS对齐;最后,构建绑定模板以编码初始点云与FLAME之间的空间关系。通过该模板动态形变3DGS,可实现实时渲染。结合扩散引导的规范3DGS生成与基于FLAME的控制,本方法在新视角生成与表情变化方面优于当前最佳方法,在公共数据集上表现更优,显著提升真实感与3D一致性。该技术适用于广泛的VR/AR应用场景。项目主页见 https://github.com/hailsong/savatar。
原文摘要 · Abstract (English)
We propose S-Avatar, a novel method for generating photorealistic 3D head avatars from a single image using a diffusion-guided 3D model generation module and strategies for animating 3D Gaussian Splatting (3DGS). While single-image head avatar reconstruction is crucial for lifelike Virtual Reality (VR) applications, existing approaches often struggle to preserve 3D consistency under unseen viewpoints. S-Avatar addresses this limitation through a three-stage pipeline. First, a high-resolution 3DGS is synthesized directly from a single image using a diffusion-based Gaussian splat generation module. Next, the parametric head model FLAME is aligned with the generated 3DGS by optimizing its parameters and spatial transformations. Finally, to adapt the 3DGS to FLAME variations, we construct a binding template that encodes the spatial relationship between the initial splats and FLAME. The dynamic 3D head avatar can then be rendered in real time by deforming the 3DGS with the binding template. By combining diffusion-guided canonical 3DGS generation with FLAME-based control, our method achieves efficient and accurate reconstruction with enhanced 3D consistency. Evaluations on public datasets demonstrate that S-Avatar outperforms state-of-the-art methods in novel-view and expression generation, achieving superior realism and consistency. Consequently, our approach represents a significant advance in accessible avatar creation, applicable to a wide range of VR/AR applications. The project page is available at https://github.com/hailsong/savatar.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。