提出两阶段过滤方法,确保工业缺陷检测模型持续训练时不因错误标签性能下降。
Trimming the Risk: Towards Reliable Continuous Training for Deep Learning Inspection Systems
- 先剔除低置信度预测,再用变分自编码器识别数据漂移的异常样本
- 过滤后仅保留不足9%的错误自标注数据,使生产数据性能提升最高达14%
- 适合长期运行的工业视觉系统,防止灾难性遗忘
工业制造中越来越多依赖深度学习(DL)进行缺陷检测,这类任务难以通过规则化的机器视觉算法自动化。基于深度学习的检测系统从标注图像中学习缺陷模式,兼具人类般的灵活性与计算机系统的稳定性。然而,有限的标注数据集往往无法涵盖所有自然变化,因此需要持续训练(CT)定期用新数据更新模型。有效的持续训练需依赖来自原始分布的新标注样本;否则,自生成标签可能导致无声的性能退化。为缓解这一风险,我们提出一种基于可靠数据选择的鲁棒持续训练维护方法,采用两阶段过滤流程:第一阶段剔除模型自身置信度低的预测;第二阶段利用变分自编码器和直方图生成图像嵌入,捕捉潜在特征与像素信息,拒绝嵌入显著偏移的输入以识别数据漂移带来的错误高置信度样本。随后在过滤后的数据上对原始深度学习模型进行微调,并在近期生产数据与原始数据混合验证集上评估。该策略有效缓解灾难性遗忘,确保模型适应新工况。在冰棒棍印刷品和玻璃瓶的工业检测系统上,使用真实世界数据集评估表明,过滤后用于微调的错误自标注数据占比低于9%,模型在生产数据上的性能提升最高达14%,且未影响其在原始验证数据上的表现。
原文摘要 · Abstract (English)
The industry increasingly relies on deep learning (DL) technology for manufacturing inspections, which are challenging to automate with rule-based machine vision algorithms. DL-powered inspection systems derive defect patterns from labeled images, combining human-like agility with the consistency of a computerized system. However, finite labeled datasets often fail to encompass all natural variations necessitating Continuous Training (CT) to regularly adjust their models with recent data. Effective CT requires fresh labeled samples from the original distribution; otherwise, selfgenerated labels can lead to silent performance degradation. To mitigate this risk, we develop a robust CT-based maintenance approach that updates DL models using reliable data selections through a two-stage filtering process. The initial stage filters out low-confidence predictions, as the model inherently discredits them. The second stage uses variational auto-encoders and histograms to generate image embeddings that capture latent and pixel characteristics, then rejects the inputs of substantially shifted embeddings as drifted data with erroneous overconfidence. Then, a fine-tuning of the original DL model is executed on the filtered inputs while validating on a mixture of recent production and original datasets. This strategy mitigates catastrophic forgetting and ensures the model adapts effectively to new operational conditions. Evaluations on industrial inspection systems for popsicle stick prints and glass bottles using critical real-world datasets showed less than 9% of erroneous self-labeled data are retained after filtering and used for fine-tuning, improving model performance on production data by up to 14% without compromising its results on original validation data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。