对比DINOv3与ImageNet预训练在工业缺陷检测中的效果,发现模态和微调方式影响显著。
Rethinking Transfer Learning for Industrial Inspection: DINOv3 vs. ImageNet Pretraining Across RGB and X-ray Tasks
- 用DINOv3和ImageNet预训练的ConvNeXt模型进行跨任务比较
- 全微调后DINOv3在RGB任务中收敛更快、性能更好
- X-ray任务中传统ImageNet预训练仍更优,提示模态依赖性
基于网络规模数据预训练的视觉基础模型在诸多下游任务中展现出强大的迁移能力,但在工业视觉检测中的有效性尚不明确。工业数据与网络数据差异大,且常需细粒度密集预测,这引发疑问:现代自监督预训练是否优于传统的基于监督ImageNet初始化的迁移学习范式。本文比较了使用监督ImageNet分类或DINOv3蒸馏预训练的ConvNeXt主干网络,并与传统ResNet-50基线对比。在涵盖RGB表面缺陷检测和X-ray缺陷检测的四个下游数据集上,评估了语义分割、实例分割和目标检测任务,同时研究了冻结和全微调两种适应策略。结果表明,冻结迁移时DINOv3无明显优势;但在全微调下,其在RGB任务中可实现更快收敛和更优最终性能。而在X-ray模态迁移中,监督ImageNet预训练在冻结与微调设置下均表现更佳。总体而言,现代视觉基础模型对监督式RGB工业检测有潜力,但其迁移能力强烈依赖下游适配方式与目标模态。
原文摘要 · Abstract (English)
Vision foundation models pretrained on web-scale data have recently shown strong transfer capabilities on many downstream tasks, but their effectiveness for industrial visual inspection remains unclear. Industrial data differ substantially from web-data and often require fine-grained dense prediction, raising the question of whether modern self-supervised pretraining can improve over the conventional transfer-learning paradigm based on supervised ImageNet initialization. In this work, we compare ConvNeXt backbones pretrained with supervised ImageNet classification or DINOv3 distillation, and relate them to the conventional ResNet-50 baseline. We evaluate semantic segmentation, instance segmentation, and object detection across four downstream datasets spanning RGB surface-defect inspection and X-ray defect detection. We further study both frozen and fully finetuned adaptation regimes. Our results show that DINOv3 offers no clear advantage in frozen transfer, but provides a stronger initialization after full finetuning on RGB tasks, yielding faster convergence and better final performance. Under X-ray modality shift, however, supervised ImageNet pretraining remains more effective in both frozen and finetuned settings. Overall, our findings suggest that modern vision foundation models are promising for supervised RGB industrial inspection, but their transferability is strongly conditioned by downstream adaptation and target modality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。