通过逐步规划最优视角,用最少照片实现高质量三维重建。
PVP-Recon: Progressive View Planning via Warping Consistency for Sparse-View Surface Reconstruction
- 基于视角变换一致性评分,自动选择信息量最大的下一视角。
- 仅需3张初始图像,逐步添加新视角,重建精度显著提升。
- 适合资源受限场景下的高效三维建模,如机器人巡检。
神经隐式表示已推动密集多视角三维重建的发展,但在稀疏输入视角下性能明显下降。现有方法尝试通过引入几何先验或多场景泛化能力解决此问题,但仍受限于输入视角选择不佳,通常依赖经验设定的视点以保证重叠度。本文提出PVP-Recon,一种新型且高效的稀疏视角表面重建方法,可逐步规划下一最佳视角,形成最优稀疏视角集合。该方法从最少3个视角开始进行初始重建,并依据一种新颖的变形评分机制,决定新增视角的信息增益。该渐进式视点规划过程与基于神经SDF的重建模块交替进行,后者采用多分辨率哈希特征,结合渐进训练策略和方向性海森损失。在三个基准数据集上的定量与定性实验表明,本框架在有限输入预算下实现了高质量重建,优于现有基线方法。
原文摘要 · Abstract (English)
Neural implicit representations have revolutionized dense multi-view surface reconstruction, yet their performance significantly diminishes with sparse input views. A few pioneering works have sought to tackle the challenge of sparse-view reconstruction by leveraging additional geometric priors or multi-scene generalizability. However, they are still hindered by the imperfect choice of input views, using images under empirically determined viewpoints to provide considerable overlap. We propose PVP-Recon, a novel and effective sparse-view surface reconstruction method that progressively plans the next best views to form an optimal set of sparse viewpoints for image capturing. PVP-Recon starts initial surface reconstruction with as few as 3 views and progressively adds new views which are determined based on a novel warping score that reflects the information gain of each newly added view. This progressive view planning progress is interleaved with a neural SDF-based reconstruction module that utilizes multi-resolution hash features, enhanced by a progressive training scheme and a directional Hessian loss. Quantitative and qualitative experiments on three benchmark datasets show that our framework achieves high-quality reconstruction with a constrained input budget and outperforms existing baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。