arXiv:2501.09579cs.CVcs.GR2025-01被引 4

用合成水渍提升表面缺陷检测,解决大图训练内存瓶颈

Sequential PatchCore: Anomaly Detection for Surface Inspection using Synthetic Impurities

  • 通过程序化生成逼真水渍,构建含杂质的合成数据集
  • 提出Sequential PatchCore,实现消费级硬件上大图训练
  • 合成数据预训练+真实数据微调,显著提升工业检测性能

表面杂质(如水渍、指纹、贴纸)常导致自动化视觉检测系统性能下降。现有合成数据生成多聚焦于理想样本和缺陷,忽视杂质影响。本文强调杂质在合成数据中的重要性,提出一种程序化方法生成逼真水渍,并构建与真实数据对齐的合成数据集。这些数据用于训练异常检测模型并研究水渍的影响。高分辨率图像导致异常检测训练时内存瓶颈,为此提出Sequential PatchCore:逐次构建核心集,使在消费级硬件上训练大图像成为可能。该方法支持基于不同数据版本预训练的核心集进行迁移学习。实验表明,使用合成数据预训练显式核心集异常模型具有优势,且利用真实数据微调可进一步提升性能。我们还观察到杂质和标注模糊会降低模型表现,并报告了按缺陷类别的召回率,提供工业应用视角下的性能评估。

原文摘要 · Abstract (English)

The appearance of surface impurities (e.g., water stains, fingerprints, stickers) is an often-mentioned issue that causes degradation of automated visual inspection systems. At the same time, synthetic data generation techniques for visual surface inspection have focused primarily on generating perfect examples and defects, disregarding impurities. This study highlights the importance of considering impurities when generating synthetic data. We introduce a procedural method to include photorealistic water stains in synthetic data. The synthetic datasets are generated to correspond to real datasets and are further used to train an anomaly detection model and investigate the influence of water stains. The high-resolution images used for surface inspection lead to memory bottlenecks during anomaly detection training. To address this, we introduce Sequential PatchCore - a method to build coresets sequentially and make training on large images using consumer-grade hardware tractable. This allows us to perform transfer learning using coresets pre-trained on different dataset versions. Our results show the benefits of using synthetic data for pre-training an explicit coreset anomaly model and the extended performance benefits of finetuning the coreset using real data. We observed how the impurities and labelling ambiguity lower the model performance and have additionally reported the defect-wise recall to provide an industrially relevant perspective on model performance.

异常检测合成数据表面质检

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。