融合视觉与激光雷达,实现混凝土裂缝的3D精准建模与自动测量。
3D Modeling and Automated Measurement of Concrete Cracks via Segment Anything Refinement and Visual Inertial LiDAR Fusion
- 基于SAM改进分割模型,提升复杂场景下裂缝检测泛化能力。
- 结合图像与激光雷达数据,生成带语义的稠密3D点云。
- 直接在3D点云中自动测量裂缝几何属性,适合曲面结构。
视觉-空间系统在混凝土裂缝检测中日益重要。现有方法普遍缺乏对多样化场景的适应性,图像方法鲁棒性不足,且难以处理曲线或复杂几何结构。为此,本文提出一种融合计算机视觉与多模态同步定位与地图构建(SLAM)的新框架,实现二维裂缝检测、三维重建与三维自动测量。首先,在DeepLabv3+基础上引入基础模型Segment Anything Model(SAM)进行精细化分割,生成具有强泛化能力的2D裂缝掩码。为提升3D重建精度与鲁棒性,融合激光雷达点云、图像数据与分割掩码,利用图像与激光雷达双路SLAM,构建多帧多模态融合框架,生成稠密彩色点云,实现真实世界尺度下裂缝语义的精确捕捉。进一步在3D稠密点云空间中直接自动测量裂缝几何属性,突破传统2D图像测量局限。实验结果表明,该方法在多种混凝土结构上均表现优异,具备高有效性、准确性和实际应用鲁棒性。
原文摘要 · Abstract (English)
Visual-Spatial Systems has become increasingly essential in concrete crack inspection. However, existing methods often lacks adaptability to diverse scenarios, exhibits limited robustness in image-based approaches, and struggles with curved or complex geometries. To address these limitations, an innovative framework for two-dimensional (2D) crack detection, three-dimensional (3D) reconstruction, and 3D automatic crack measurement was proposed by integrating computer vision technologies and multi-modal Simultaneous localization and mapping (SLAM) in this study. Firstly, building on a base DeepLabv3+ segmentation model, and incorporating specific refinements utilizing foundation model Segment Anything Model (SAM), we developed a crack segmentation method with strong generalization across unfamiliar scenarios, enabling the generation of precise 2D crack masks. To enhance the accuracy and robustness of 3D reconstruction, Light Detection and Ranging (LiDAR) point clouds were utilized together with image data and segmentation masks. By leveraging both image- and LiDAR-SLAM, we developed a multi-frame and multi-modal fusion framework that produces dense, colorized point clouds, effectively capturing crack semantics at a 3D real-world scale. Furthermore, the crack geometric attributions were measured automatically and directly within 3D dense point cloud space, surpassing the limitations of conventional 2D image-based measurements. This advancement makes the method suitable for structural components with curved and complex 3D geometries. Experimental results across various concrete structures highlight the significant improvements and unique advantages of the proposed method, demonstrating its effectiveness, accuracy, and robustness in real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。