arXiv:2502.11338cs.CV2025-02被引 1

用大模型提升焊缝射线检测缺陷分割,跨场景泛化能力强。

WRT-SAM: Foundation Model-Driven Segmentation for Generalized Weld Radiographic Testing

  • 基于SAM构建适配焊缝图像的分割框架,引入频域与多尺度提示生成器。
  • 在多个数据集上实现78.87%召回率、84.04%精确率、0.9746 AUC,刷新纪录。
  • 零样本迁移表现优异,适合工业中复杂多变的检测场景部署。

射线检测是工业应用中识别焊缝缺陷和评估质量的重要无损检测技术,因其高分辨率成像能力而被广泛应用。过去十年,深度学习显著提升了射线图像中的焊缝缺陷识别能力。然而,传统方法依赖于小规模、特定场景的数据集训练专用模型,跨场景泛化能力差。最近,基于大规模数据预训练的视觉基础模型Segment Anything Model(SAM)展现出卓越的零样本泛化能力。通过少量领域特定数据微调,已在医学图像分割和异常检测等领域取得良好效果。据我们所知,本文首次将SAM应用于通用焊缝射线检测图像的分割任务。提出WRT-SAM,一种新型焊缝缺陷分割模型,通过适配器机制融合专用提示生成架构。为增强对灰度焊缝图像的适应性,引入频率提示生成模块,提升模型对频域信息的敏感度;为应对焊缝缺陷的多尺度特性,设计多尺度提示生成模块,有效提取并编码不同尺度的缺陷特征。大量实验表明,WRT-SAM在多个数据集上达到78.87%召回率、84.04%精确率、0.9746 AUC,创下新SOTA。同时表现出优异的零样本泛化性能,具备在多样化射线检测场景中实际部署的潜力。

原文摘要 · Abstract (English)

Radiographic testing is a fundamental non-destructive evaluation technique for identifying weld defects and assessing quality in industrial applications due to its high-resolution imaging capabilities. Over the past decade, deep learning techniques have significantly advanced weld defect identification in radiographic images. However, conventional approaches, which rely on training small-scale, task-specific models on single-scenario datasets, exhibit poor cross-scenario generalization. Recently, the Segment Anything Model (SAM), a pre-trained visual foundation model trained on large-scale datasets, has demonstrated exceptional zero-shot generalization capabilities. Fine-tuning SAM with limited domain-specific data has yielded promising results in fields such as medical image segmentation and anomaly detection. To the best of our knowledge, this work is the first to introduce SAM-based segmentation for general weld radiographic testing images. We propose WRT-SAM, a novel weld radiographic defect segmentation model that leverages SAM through an adapter-based integration with a specialized prompt generator architecture. To improve adaptability to grayscale weld radiographic images, we introduce a frequency prompt generator module, which enhances the model's sensitivity to frequency-domain information. Furthermore, to address the multi-scale nature of weld defects, we incorporate a multi-scale prompt generator module, enabling the model to effectively extract and encode defect information across varying scales. Extensive experimental evaluations demonstrate that WRT-SAM achieves a recall of 78.87%, a precision of 84.04%, and an AUC of 0.9746, setting a new state-of-the-art (SOTA) benchmark. Moreover, the model exhibits superior zero-shot generalization performance, highlighting its potential for practical deployment in diverse radiographic testing scenarios.

缺陷检测分割模型SAM工业质检

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。