arXiv:2410.09409cs.CV2024-10

解决道路裂缝分割中标签噪声问题,提升模型泛化能力。

Distribution-aware Noisy-label Crack Segmentation

  • 利用分布感知的领域知识引导SAM-Adapter学习,缓解小样本噪声标签影响。
  • 在两个公开数据集上显著优于现有方法,跨域测试在CFD上表现优异。
  • 适合需要高鲁棒性与跨场景应用的道路检测系统开发者。

道路裂缝分割对机器人系统进行道路基础设施巡检、维护和监控至关重要。现有基于深度学习的方法通常在特定数据集上训练,导致在未见真实场景中性能显著下降。为此,我们引入SAM-Adapter,将通用的Segment Anything Model(SAM)知识融入裂缝分割任务,展现出更强的性能与泛化能力。然而,SAM-Adapter的效果受限于小规模训练集中存在的噪声标签,包括裂缝遗漏和误标。本文提出一种创新的联合学习框架,利用分布感知的领域特定语义知识指导SAM-Adapter的判别学习过程。据我们所知,这是首个有效降低噪声标签对SAM-Adapter监督学习负面影响的方法。在两个公开路面裂缝分割数据集上的实验结果表明,该方法显著优于现有最先进技术。此外,在完全未见过的CFD数据集上的评估进一步验证了模型出色的跨域泛化能力,凸显其在实际裂缝分割应用中的潜力。

原文摘要 · Abstract (English)

Road crack segmentation is critical for robotic systems tasked with the inspection, maintenance, and monitoring of road infrastructures. Existing deep learning-based methods for crack segmentation are typically trained on specific datasets, which can lead to significant performance degradation when applied to unseen real-world scenarios. To address this, we introduce the SAM-Adapter, which incorporates the general knowledge of the Segment Anything Model (SAM) into crack segmentation, demonstrating enhanced performance and generalization capabilities. However, the effectiveness of the SAM-Adapter is constrained by noisy labels within small-scale training sets, including omissions and mislabeling of cracks. In this paper, we present an innovative joint learning framework that utilizes distribution-aware domain-specific semantic knowledge to guide the discriminative learning process of the SAM-Adapter. To our knowledge, this is the first approach that effectively minimizes the adverse effects of noisy labels on the supervised learning of the SAM-Adapter. Our experimental results on two public pavement crack segmentation datasets confirm that our method significantly outperforms existing state-of-the-art techniques. Furthermore, evaluations on the completely unseen CFD dataset demonstrate the high cross-domain generalization capability of our model, underscoring its potential for practical applications in crack segmentation.

裂缝分割噪声标签SAM泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。