arXiv:2411.14953cs.CVcs.AI2024-11被引 1

评测视觉Transformer在工业质检中的表现,帮工程师选对模型。

Evaluating Vision Transformer Models for Visual Quality Control in Industrial Manufacturing

  • 用SOTA视觉Transformer+异常检测算法组合测试
  • 在MVTecAD和BTAD数据集上验证,兼顾精度与速度
  • 给出基于场景和硬件的选型指南

工业制造中机器学习最有前景的应用之一是通过质量控制系统早期发现缺陷产品,从而降低成本并减少因重复性视觉检查带来的人员失误。当前已有大量研究利用机器学习方法,在不平衡的视觉质检数据集中识别罕见缺陷。这些方法通常包含两个部分:一个视觉主干网络提取输入图像特征,以及一个异常检测算法判断特征是否在预期分布内。随着视觉变换器(Vision Transformer)成为主流视觉主干,二者组合形式多样,需在检测性能与推理速度间权衡。为帮助从业者快速选定合适组合,本文系统评测了当前SOTA的视觉变压器模型与异常检测方法。我们选取两类前沿模型进行组合,并在著名的MVTecAD和BTAD数据集上评估其性能。实验结果可支撑构建小型、快速且高效的异常检测模型,适用于工业制造场景。同时,本文还提供实际部署时根据具体使用场景与硬件限制选择模型架构的指导建议。

原文摘要 · Abstract (English)

One of the most promising use-cases for machine learning in industrial manufacturing is the early detection of defective products using a quality control system. Such a system can save costs and reduces human errors due to the monotonous nature of visual inspections. Today, a rich body of research exists which employs machine learning methods to identify rare defective products in unbalanced visual quality control datasets. These methods typically rely on two components: A visual backbone to capture the features of the input image and an anomaly detection algorithm that decides if these features are within an expected distribution. With the rise of transformer architecture as visual backbones of choice, there exists now a great variety of different combinations of these two components, ranging all along the trade-off between detection quality and inference time. Facing this variety, practitioners in the field often have to spend a considerable amount of time on researching the right combination for their use-case at hand. Our contribution is to help practitioners with this choice by reviewing and evaluating current vision transformer models together with anomaly detection methods. For this, we chose SotA models of both disciplines, combined them and evaluated them towards the goal of having small, fast and efficient anomaly detection models suitable for industrial manufacturing. We evaluated the results of our experiments on the well-known MVTecAD and BTAD datasets. Moreover, we give guidelines for choosing a suitable model architecture for a quality control system in practice, considering given use-case and hardware constraints.

视觉Transformer工业质检异常检测模型选型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。