用扩散模型融合灰度与深度图,提升道路裂缝分割精度。
CrackSegDiff: Diffusion Probability Model-based Multi-modal Crack Segmentation
- 基于扩散模型融合灰度与深度图像,增强去噪能力。
- 在FIND数据集上三类裂缝分割表现超越现有方法,浅裂缝检测更优。
- 适合道路检测、智能巡检系统开发者参考使用。
将灰度图与深度图结合用于道路巡检机器人,可提升道路状况评估的准确性、可靠性和全面性,从而优化维护策略并保障基础设施安全。然而,这些数据常受路面背景噪声干扰。近年来,扩散概率模型(DPM)在图像分割任务中展现出显著成效,具备强大去噪能力,如SegDiff所示。尽管如此,现有DPM分割器未能充分挖掘原始图像数据潜力。本文提出一种新型DPM-based裂缝分割方法CrackSegDiff,首次融合灰度图与深度图。该方法通过强化局部特征(由DPM提取)与全局特征之间的交互,改进逆向扩散过程。不同于传统采用Transformer提取全局特征的方法,本工作使用Vm-unet高效捕获原始数据的长程信息。特征融合进一步通过两个创新模块——通道融合模块(CFM)和浅层特征补偿模块(SFCM)——实现优化。在FIND数据集上的三类裂缝分割实验表明,CrackSegDiff优于当前最先进方法,尤其在浅裂缝检测方面表现突出。
原文摘要 · Abstract (English)
Integrating grayscale and depth data in road inspection robots could enhance the accuracy, reliability, and comprehensiveness of road condition assessments, leading to improved maintenance strategies and safer infrastructure. However, these data sources are often compromised by significant background noise from the pavement. Recent advancements in Diffusion Probabilistic Models (DPM) have demonstrated remarkable success in image segmentation tasks, showcasing potent denoising capabilities, as evidenced in studies like SegDiff. Despite these advancements, current DPM-based segmentors do not fully capitalize on the potential of original image data. In this paper, we propose a novel DPM-based approach for crack segmentation, named CrackSegDiff, which uniquely fuses grayscale and range/depth images. This method enhances the reverse diffusion process by intensifying the interaction between local feature extraction via DPM and global feature extraction. Unlike traditional methods that utilize Transformers for global features, our approach employs Vm-unet to efficiently capture long-range information of the original data. The integration of features is further refined through two innovative modules: the Channel Fusion Module (CFM) and the Shallow Feature Compensation Module (SFCM). Our experimental evaluation on the three-class crack image segmentation tasks within the FIND dataset demonstrates that CrackSegDiff outperforms state-of-the-art methods, particularly excelling in the detection of shallow cracks. Code is available at https://github.com/sky-visionX/CrackSegDiff.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。