arXiv:2511.20366cs.CV2025-11AAAI被引 4

用3D基础模型实现野生多视角人脸几何的自动拓扑一致重建。

VGGTFace: Topologically Consistent Facial Geometry Reconstruction in the Wild

  • 基于VGGT点图表示,结合像素对齐的UV值注入拓扑信息。
  • 16视角输入下10秒内完成高质量重建,性能超越现有方法。
  • 适合数字人生成、虚拟形象建模等需要高保真人脸的应用。

构建拓扑一致的人脸几何对于数字角色创建至关重要。现有方法或需繁琐手动操作,或难以泛化至野外数据,或受限于3D形态模型的表达能力。为此,我们提出VGGTFace,一种自动方法,创新性地利用3D基础模型VGGT,从普通用户拍摄的野外多视角图像中重建拓扑一致的人脸几何。核心洞察是:通过VGGT,方法自然继承其大规模训练带来的强泛化能力和高表达力。然而,由于预测结果缺乏拓扑信息,如何从中重建拓扑一致网格尚不明确。为此,我们引入Pixel3DMM,通过像素对齐的UV值注入拓扑信息,将VGGT的像素对齐点图转化为带拓扑的点云。针对该已知拓扑的点云,我们设计了一种新型拓扑感知束调整策略,通过构建拉普拉斯能量项优化目标。在单张NVIDIA RTX 4090上,16视角输入可在10秒内实现高质量重建。实验表明,该方法在基准测试中达到最先进水平,并展现出出色的野外数据泛化能力。代码已开源:https://github.com/grignarder/vggtface。

原文摘要 · Abstract (English)

Reconstructing topologically consistent facial geometry is crucial for the digital avatar creation pipelines. Existing methods either require tedious manual efforts, lack generalization to in-the-wild data, or are constrained by the limited expressiveness of 3D Morphable Models. To address these limitations, we propose VGGTFace, an automatic approach that innovatively applies the 3D foundation model, i.e. VGGT, for topologically consistent facial geometry reconstruction from in-the-wild multi-view images captured by everyday users. Our key insight is that, by leveraging VGGT, our method naturally inherits strong generalization ability and expressive power from its large-scale training and point map representation. However, it is unclear how to reconstruct a topologically consistent mesh from VGGT, as the topology information is missing in its prediction. To this end, we augment VGGT with Pixel3DMM for injecting topology information via pixel-aligned UV values. In this manner, we convert the pixel-aligned point map of VGGT to a point cloud with topology. Tailored to this point cloud with known topology, we propose a novel Topology-Aware Bundle Adjustment strategy to fuse them, where we construct a Laplacian energy for the Bundle Adjustment objective. Our method achieves high-quality reconstruction in 10 seconds for 16 views on a single NVIDIA RTX 4090. Experiments demonstrate state-of-the-art results on benchmarks and impressive generalization to in-the-wild data. Code is available at https://github.com/grignarder/vggtface.

人脸重建3D生成拓扑保持多视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。