arXiv:2605.31283cs.CV2026-05International Conf…

用分层采样实现高效高精度3D人脸重建,内存占用降88%。

Topologically Consistent Multi-view 3D Head Reconstruction via Coarse-Guided Layered Surface Sampling

论文配图:Topologically Consistent Multi-view 3D Head Reconstruction via Coarse-Guided Layered Surface Sampling
图 1 · 摘自论文原文
  • 分层采样分离特征与网格分辨率,提升可扩展性。
  • 18000顶点网格下误差降低21%-29%,推理速度提升3.5倍。
  • 仅用合成数据训练,仍能良好适配真实图像,无需昂贵标注数据。

我们提出SHELLS(基于分层局部采样的语义头部估计),一个高效的前馈框架,用于从多视角图像中进行密集语义对应下的3D头部重建。现有方法通常通过局部特征体独立优化顶点,将内存密集的特征采样与网格分辨率耦合,限制了密集拓扑(>10,000顶点)的可扩展性并引入表面噪声。相比之下,SHELLS通过分层采样策略解耦特征提取与网格分辨率。我们使用DINOv2骨干网络结合LoRA适配提取多视角特征,投影生成稀疏全局特征云,并预测中间粗略网格。该粗略先验引导构建分层、表面感知的采样壳层,作为最终重建的离散搜索空间。SHELLS在保持表面一致性的同时,推理显存仅需2.4GB(相比体素基线的20GB减少88%),在18,000顶点网格上将中位注册误差降低21%~29%,推理速度提升3.5倍(0.08秒 vs. 0.29秒)。值得注意的是,模型仅在合成数据上训练,却能有效泛化至真实世界采集数据,无需依赖以往工作常见的昂贵且预对齐的多视角数据集。

原文摘要 · Abstract (English)

We present SHELLS (Semantic Head Estimation via Layered Local Sampling), an efficient feed-forward framework for 3D head reconstruction in dense semantic correspondence from multi-view images. Existing methods typically refine vertices independently via localized feature volumes. This approach couples memory-intensive feature sampling to mesh resolution, which limits scalability for dense topologies (> 10k vertices) and introduces surface noise. In contrast, SHELLS decouples feature extraction from mesh resolution via a hierarchical sampling strategy. We extract multi-view features using a DINOv2 backbone with LoRA adaptation, projectively sample a sparse global feature cloud, and predict an intermediate coarse mesh. This coarse prior guides the construction of layered, surface-aware sampling shells that serve as a discrete search space for the final reconstruction. SHELLS maintains surface consistency while using 88% less inference GPU memory (2.4GB vs. 20GB) than volumetric baselines. It reduces median registration error by 21% to 29% with a 3.5x inference speedup (0.08s vs. 0.29s) for 18k-vertex meshes. Notably, our model is trained exclusively on synthetic data yet generalizes effectively to real-world captures, eliminating the need for the costly, pre-registered multi-view datasets common in prior work.

3D重建多视角分层采样显存优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。