用平面先验提升弱纹理建筑3D重建精度,效果优于当前最佳方法。
Segmentation-aware Prior Assisted Joint Global Information Aggregated 3D Building Reconstruction
- 基于SAM与RANSAC分割弱纹理区域,构建平面先验
- 融合全局信息聚合成本函数,提升深度估计准确性
- 适合城市规划与虚拟现实中的高精度3D建模
多视图立体视觉在土木工程中对三维建模、精准测绘、量化分析及监测维护至关重要,能提供高精度实时空间信息。然而,在大规模建筑场景中,该方法在弱纹理区域面临立体匹配失败问题,导致深度估计不准确。本文基于Segment Anything Model和RANSAC算法,提出一种方法以精确分割弱纹理区域并构建其平面先验。这些平面先验结合三角化先验,形成可靠的先验候选集。同时,引入一种新型全局信息聚合代价函数,基于先验候选集中的全局信息选择最优平面先验,并在深度更新过程中受几何一致性约束。在ETH3D基准数据集、航拍数据集、建筑数据集及真实场景上的实验结果表明,本方法在生成3D建筑模型方面优于其他先进方法。本研究旨在提升3D建筑重建的完整性和密度,对城市规划与虚拟现实具有广泛应用意义。
原文摘要 · Abstract (English)
Multi-View Stereo plays a pivotal role in civil engineering by facilitating 3D modeling, precise engineering surveying, quantitative analysis, as well as monitoring and maintenance. It serves as a valuable tool, offering high-precision and real-time spatial information crucial for various engineering projects. However, Multi-View Stereo algorithms encounter challenges in reconstructing weakly-textured regions within large-scale building scenes. In these areas, the stereo matching of pixels often fails, leading to inaccurate depth estimations. Based on the Segment Anything Model and RANSAC algorithm, we propose an algorithm that accurately segments weakly-textured regions and constructs their plane priors. These plane priors, combined with triangulation priors, form a reliable prior candidate set. Additionally, we introduce a novel global information aggregation cost function. This function selects optimal plane prior information based on global information in the prior candidate set, constrained by geometric consistency during the depth estimation update process. Experimental results on both the ETH3D benchmark dataset, aerial dataset, building dataset and real scenarios substantiate the superior performance of our method in producing 3D building models compared to other state-of-the-art methods. In summary, our work aims to enhance the completeness and density of 3D building reconstruction, carrying implications for broader applications in urban planning and virtual reality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。