用少量照片快速生成可动的3D人脸,支持逐步添加图片优化效果。
FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images

- 基于Transformer和3D高斯,分离身份与表情/视角变化,保持形象一致。
- 通过稀疏到稠密学习,先粗后精重建细节,兼顾质量与效率。
- 支持增量式输入,适合个性化动态人脸建模,尤其适合视频生成场景。
我们提出FFAvatar,一种基于Transformer的3D高斯框架,可从单张或多张参考肖像图中快速构建高质量、可驱动的4D头部动画形象。不同于现有前馈方法需固定输入视角数量,FFAvatar支持增量式重建,随新图像加入逐步优化表征。核心是交替注意力机制,将身份外观与表情及视角变化解耦,实现跨姿态与表情的一致性标准3D外观重建。为平衡视觉保真度与计算效率,引入稀疏到稠密学习范式:先在FLAME顶点层级锚定稀疏基元学习粗粒度外观特征,再在UV域稠密化以捕捉精细几何与纹理细节。此外,提出即插即用的运动精修模块,通过建模参数化变形外的残差运动,实现个体化动态定制。大量实验表明,FFAvatar能高效生成高保真、可控的4D头部形象,在多种表情与视角下均表现出卓越灵活性、驱动效率与身份一致性。
原文摘要 · Abstract (English)
We present FFAvatar, a Transformer-based 3D Gaussian framework for fast construction of high-quality and animatable 4D head avatars from one or more reference portrait images. Unlike existing feed-forward approaches that require a fixed number of input views, FFAvatar supports incremental reconstruction, progressively refining the avatar representation as additional reference images become available. At the core of our method is an alternating attention mechanism that disentangles identity appearance from expression and viewpoint variations, enabling the reconstruction of a canonical 3D appearance that remains consistent across poses and facial expressions. To balance visual fidelity and computational efficiency, we introduce a sparse-to-dense learning paradigm. Coarse appearance features are first learned using sparse primitives anchored to the FLAME vertex level and are subsequently densified in the UV domain to capture fine-grained geometric and texture details. We further propose a plug-and-play motion refinement module that enables subject-specific dynamic personalization by modeling residual motion beyond parametric deformation. Extensive experiments demonstrate that FFAvatar efficiently produces high-fidelity and controllable 4D head avatars, achieving superior flexibility, driving efficiency, and identity-consistent rendering across diverse expressions and viewpoints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。