用几何先验优化手机拍摄的室内重建,提升细节精度。
AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphones
- 基于几何先验自适应过滤低质量深度与法向估计
- 在复杂室内场景中显著提升网格生成与新视角合成效果
- 适合移动端3D重建与细节恢复研究者使用
几何先验常用于增强三维重建效果。由于智能手机普遍配备低分辨率深度传感器,且常用单目几何估计算法,将几何先验作为正则化信号已成为三维视觉任务中的常见做法。然而,移动设备的深度估计对精细几何结构准确性较差,单目方法也常存在多视图一致性差、精度不足的问题。本文提出一种联合表面深度与法向精修的高斯点云方法,用于准确重建室内场景。通过在优化过程中对比先验的一致性,设计自适应过滤策略,有效降低高不确定性区域的正则化强度。该策略在3D与2D高斯点云方法上均显著提升网格估计与新视角合成性能,在挑战性室内房间数据集上表现优异。此外,我们探索了替代性网格化策略,提出受TSDF与八叉树等值面提取启发的尺度感知网格化方法,从高斯模型中恢复更精细的几何细节,优于常用开源工具。代码已公开于 https://xuqianren.github.io/ags_mesh_website/。
原文摘要 · Abstract (English)
Geometric priors are often used to enhance 3D reconstruction. With many smartphones featuring low-resolution depth sensors and the prevalence of off-the-shelf monocular geometry estimators, incorporating geometric priors as regularization signals has become common in 3D vision tasks. However, the accuracy of depth estimates from mobile devices is typically poor for highly detailed geometry, and monocular estimators often suffer from poor multi-view consistency and precision. In this work, we propose an approach for joint surface depth and normal refinement of Gaussian Splatting methods for accurate 3D reconstruction of indoor scenes. We develop supervision strategies that adaptively filters low-quality depth and normal estimates by comparing the consistency of the priors during optimization. We mitigate regularization in regions where prior estimates have high uncertainty or ambiguities. Our filtering strategy and optimization design demonstrate significant improvements in both mesh estimation and novel-view synthesis for both 3D and 2D Gaussian Splatting-based methods on challenging indoor room datasets. Furthermore, we explore the use of alternative meshing strategies for finer geometry extraction. We develop a scale-aware meshing strategy inspired by TSDF and octree-based isosurface extraction, which recovers finer details from Gaussian models compared to other commonly used open-source meshing tools. Our code is released in https://xuqianren.github.io/ags_mesh_website/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。