利用裂缝细长特性生成鲁棒线索,提升检测泛化能力
Coarse-to-fine crack cue for robust crack detection
- 从粗到细生成无裂缝背景,提取受环境干扰小的裂缝线索
- 在多个数据集上显著提升基线模型的泛化性能和抗干扰能力
- 可直接嵌入现有检测网络,适合实际场景中复杂光照下的裂缝识别
裂缝检测是计算机视觉中的重要任务。尽管基于深度学习的方法在训练数据集上表现优异,但在未见域上的泛化能力仍不足。以往方法常忽略裂缝的细长结构特性。本文提出 CrackCue,一种基于粗到细裂缝线索生成的鲁棒裂缝检测新方法。核心思想是利用裂缝的细长属性生成稳健的裂缝线索,指导检测过程。具体而言,先对裂缝图像进行简单的最大池化与上采样操作,得到粗粒度无裂缝背景;再通过重建网络获取精细无裂缝背景;原始图像与精细无裂缝背景之差即为精细裂缝线索。该线索蕴含不受复杂背景、阴影及光照变化影响的鲁棒裂缝先验信息。作为即插即用模块,CrackCue 被集成至三种先进裂缝检测网络中。大量实验表明,所提方法显著提升了基线模型的泛化能力和鲁棒性。源代码将公开。
原文摘要 · Abstract (English)
Crack detection is an important task in computer vision. Despite impressive in-dataset performance, deep learning-based methods still struggle in generalizing to unseen domains. The thin structure property of cracks is usually overlooked by previous methods. In this work, we introduce CrackCue, a novel method for robust crack detection based on coarse-to-fine crack cue generation. The core concept lies on leveraging the thin structure property to generate a robust crack cue, guiding the crack detection. Specifically, we first employ a simple max-pooling and upsampling operation on the crack image. This results in a coarse crack-free background, based on which a fine crack-free background can be obtained via a reconstruction network. The difference between the original image and fine crack-free background provides a fine crack cue. This fine cue embeds robust crack prior information which is unaffected by complex backgrounds, shadow, and varied lighting. As a plug-and-play method, we incorporate the proposed CrackCue into three advanced crack detection networks. Extensive experimental results demonstrate that the proposed CrackCue significantly improves the generalization ability and robustness of the baseline methods. The source code will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。