解决道路裂缝分割中标签噪声问题,提升模型泛化能力。
Distribution-aware Noisy-label Crack Segmentation
- 利用分布感知的领域知识引导SAM-Adapter学习,缓解小样本噪声标签影响。
- 在两个公开数据集上显著优于现有方法,跨域测试在CFD上表现优异。
- 适合需要高鲁棒性与跨场景应用的道路检测系统开发者。
道路裂缝分割对机器人系统进行道路基础设施巡检、维护和监控至关重要。现有基于深度学习的方法通常在特定数据集上训练,导致在未见真实场景中性能显著下降。为此,我们引入SAM-Adapter,将通用的Segment Anything Model(SAM)知识融入裂缝分割任务,展现出更强的性能与泛化能力。然而,SAM-Adapter的效果受限于小规模训练集中存在的噪声标签,包括裂缝遗漏和误标。本文提出一种创新的联合学习框架,利用分布感知的领域特定语义知识指导SAM-Adapter的判别学习过程。据我们所知,这是首个有效降低噪声标签对SAM-Adapter监督学习负面影响的方法。在两个公开路面裂缝分割数据集上的实验结果表明,该方法显著优于现有最先进技术。此外,在完全未见过的CFD数据集上的评估进一步验证了模型出色的跨域泛化能力,凸显其在实际裂缝分割应用中的潜力。
原文摘要 · Abstract (English)
Road crack segmentation is critical for robotic systems tasked with the inspection, maintenance, and monitoring of road infrastructures. Existing deep learning-based methods for crack segmentation are typically trained on specific datasets, which can lead to significant performance degradation when applied to unseen real-world scenarios. To address this, we introduce the SAM-Adapter, which incorporates the general knowledge of the Segment Anything Model (SAM) into crack segmentation, demonstrating enhanced performance and generalization capabilities. However, the effectiveness of the SAM-Adapter is constrained by noisy labels within small-scale training sets, including omissions and mislabeling of cracks. In this paper, we present an innovative joint learning framework that utilizes distribution-aware domain-specific semantic knowledge to guide the discriminative learning process of the SAM-Adapter. To our knowledge, this is the first approach that effectively minimizes the adverse effects of noisy labels on the supervised learning of the SAM-Adapter. Our experimental results on two public pavement crack segmentation datasets confirm that our method significantly outperforms existing state-of-the-art techniques. Furthermore, evaluations on the completely unseen CFD dataset demonstrate the high cross-domain generalization capability of our model, underscoring its potential for practical applications in crack segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。