用异常先验指导预训练,提升金属表面缺陷检测精度。
Advancing Metallic Surface Defect Detection via Anomaly-Guided Pretraining on a Large Industrial Dataset

- 通过异常图引导网络学习缺陷特征,解决工业图像自监督学习失效问题。
- 在12万张工业图像上预训练,相比ImageNet模型提升10%的[email protected]。
- 适合做工业质检的算法研发者,尤其关注小样本缺陷检测场景。
预训练-微调范式是缓解金属表面缺陷检测中数据稀缺问题的关键策略。然而其实施面临严峻挑战:在ImageNet等自然图像上预训练存在显著领域差异;而直接在领域内工业数据上进行朴素自监督学习,常因现有学习目标难以区分细微缺陷与复杂背景噪声而效果不佳。为此,我们提出异常引导的自监督预训练(AGSSP),通过异常先验显式指导表征学习。AGSSP采用两阶段框架:(1) 通过蒸馏异常图知识预训练模型主干,促使网络捕捉缺陷显著特征;(2) 利用异常图生成的伪缺陷框对检测器进行预训练,使其与定位任务对齐。为实现此目标,我们开发了增强型方法生成高质量异常图,并构建了一个包含12万张图像的大规模工业数据集。此外,我们还提供了两个小规模、像素级标注的金属表面缺陷数据集用于验证。大量实验表明,AGSSP在多种设置下均显著提升性能,相较基于ImageNet的模型,最高实现[email protected]提升10%,[email protected]:0.95提升11.4%。所有代码、预训练模型和数据集已公开于https://clovermini.github.io/AGSSP-Dev/。
原文摘要 · Abstract (English)
The pretraining-finetuning paradigm is a crucial strategy in metallic surface defect detection for mitigating the challenges posed by data scarcity. However, its implementation presents a critical dilemma. Pretraining on natural image datasets such as ImageNet, faces a significant domain gap. Meanwhile, naive self-supervised pretraining on in-domain industrial data is often ineffective due to the inability of existing learning objectives to distinguish subtle defect patterns from complex background noise and textures. To resolve this, we introduce Anomaly-Guided Self-Supervised Pretraining (AGSSP), a novel paradigm that explicitly guides representation learning through anomaly priors. AGSSP employs a two-stage framework: (1) it first pretrains the model's backbone by distilling knowledge from anomaly maps, encouraging the network to capture defect-salient features; (2) it then pretrains the detector using pseudo-defect boxes derived from these maps, aligning it with localization tasks. To enable this, we develop a knowledge-enhanced method to generate high-quality anomaly maps and collect a large-scale industrial dataset of 120,000 images. Additionally, we present two small-scale, pixel-level labeled metallic surface defect datasets for validation. Extensive experiments demonstrate that AGSSP consistently enhances performance across various settings, achieving up to a 10\% improvement in [email protected] and 11.4\% in [email protected]:0.95 compared to ImageNet-based models. All code, pretrained models, and datasets are publicly available at https://clovermini.github.io/AGSSP-Dev/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。