arXiv:2409.03634cs.CV2024-09ECCV被引 5

提出新框架SuRF,用表面感知方法实现高效高保真三维重建。

Surface-Centric Modeling for High-Fidelity Generalizable Neural Surface Reconstruction

论文配图:Surface-Centric Modeling for High-Fidelity Generalizable Neural Surface Reconstruction
图 1 · 摘自论文原文
  • 基于匹配场的区域稀疏化,自动识别表面边界区域
  • 在复杂场景中实现46%性能提升,内存减少80%
  • 首个无需真值深度的端到端无监督稀疏化方法

从多视角图像(尤其是稀疏图像)中重建高保真表面是近年来备受关注的关键任务。现有方法受限于内存约束或需真值深度,难以恢复精细几何结构。为此,本文提出SuRF——一种新的以表面为中心的框架,引入基于匹配场的区域稀疏化机制,在性能、效率与可扩展性间取得良好平衡。这是首个利用匹配场实现端到端无监督稀疏化的方案,通过权重分布高效定位包含表面的边界区域。不同于对每个体素预测SDF值,本方法判断体素是否位于表面区域内以实现稀疏化,从而在更低内存和计算开销下捕捉更高频表面特征。在多个包含复杂大场景的基准测试中,重建结果展现高质量细节,达到新最先进水平:性能提升46%,内存消耗降低80%。代码已开源。

原文摘要 · Abstract (English)

Reconstructing the high-fidelity surface from multi-view images, especially sparse images, is a critical and practical task that has attracted widespread attention in recent years. However, existing methods are impeded by the memory constraint or the requirement of ground-truth depths and cannot recover satisfactory geometric details. To this end, we propose SuRF, a new Surface-centric framework that incorporates a new Region sparsification based on a matching Field, achieving good trade-offs between performance, efficiency and scalability. To our knowledge, this is the first unsupervised method achieving end-to-end sparsification powered by the introduced matching field, which leverages the weight distribution to efficiently locate the boundary regions containing surface. Instead of predicting an SDF value for each voxel, we present a new region sparsification approach to sparse the volume by judging whether the voxel is inside the surface region. In this way, our model can exploit higher frequency features around the surface with less memory and computational consumption. Extensive experiments on multiple benchmarks containing complex large-scale scenes show that our reconstructions exhibit high-quality details and achieve new state-of-the-art performance, i.e., 46% improvements with 80% less memory consumption. Code is available at https://github.com/prstrive/SuRF.

三维重建表面建模稀疏化无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。