arXiv:2607.18798cs.CVcs.GR2026-07

用可学习的UV空间融合实现快速高保真人脸重建。

UVFaceFusion: Fast Multi-view Topologically Consistent Face Reconstruction in the Wild via UV-space Neural Fusion

论文配图:UVFaceFusion: Fast Multi-view Topologically Consistent Face Reconstruction in the Wild via UV-space Neural Fusion
图 1 · 摘自论文原文
  • 在标准UV空间中通过神经网络融合多视角点云,替代传统手工拓扑优化。
  • 16张输入图重建时间<3秒,且在多个公开数据集和真实场景中表现优异。
  • 适合数字人、动画制作等需快速生成固定拓扑人脸的场景。

高保真、固定拓扑的人脸几何重建对数字角色创建与动画至关重要,但现有自动化方法常在几何精度与野外泛化能力间权衡。本文提出UVFaceFusion,一种前馈式多视角、固定拓扑人脸重建框架。核心思想是将启发式拓扑优化替换为可学习的、基于标准UV空间的神经融合。给定多视角图像,先使用VGGT获取密集点图,用Pixel3DMM获取各视角的面部UV对应关系;随后将视图特异的点图提升至标准UV域,并通过新颖的掩码感知神经融合网络进行融合,生成完整的UV空间点图,进而直接采样得到固定拓扑网格。尽管仅在Ava-256上训练,该方法仍能良好泛化至多个公开基准与真实拍摄数据,得益于其几何到几何的标准化UV空间融合机制,降低了对特定数据集外观与采集条件的依赖。实验表明,该方法在多个基准上达到最先进重建精度,且在单块RTX 4090上,从16张输入图重建网格耗时不足3秒。代码已开源。

原文摘要 · Abstract (English)

Reconstructing high-fidelity facial geometry with an assigned topology is essential for digital avatar creation and animation, yet existing automated methods often trade off geometric fidelity and in-the-wild generalization. We present UVFaceFusion, a feed-forward framework for multi-view, fixed-topology face reconstruction from daily images. Our key idea is to replace heuristic topological optimization with learnable neural fusion in a canonical UV space. Given multi-view images, we first obtain dense point maps and facial UV correspondences of each view using VGGT and Pixel3DMM, respectively. Then, the view-specific point maps are lifted into the canonical UV domain and fused with a novel mask-aware neural fusion network. The network predicts a complete UV-space point map, from which a fixed-topology mesh is directly sampled. Although trained only on Ava-256, UVFaceFusion generalizes well to multiple public benchmarks and in-the-wild captures, benefiting from its canonical UV-space geometry-to-geometry fusion that reduces dependence on dataset-specific appearance and capture conditions. Experiments on various benchmarks show that UVFaceFusion achieves state-of-the-art reconstruction accuracy while reconstructing a mesh from 16 input views in less than 3 seconds on a single RTX 4090. Code is available at https://github.com/grignarder/UVFaceFusion.

人脸重建神经融合实时生成固定拓扑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。