arXiv:2505.02626cs.CV2025-05CVPR被引 8

用大模型分类工业缺陷,准确率超80%

Detect, Classify, Act: Categorizing Industrial Anomalies with Multi-Modal Large Language Models

  • 先用视觉模型检出异常,再让大模型判断缺陷类型
  • 在MVTec-AD上达80.4%准确率,比之前提升5个百分点
  • 自建带精确标签的数据集,适合工业质检研究者

近年来视觉工业异常检测在识别与分割异常区域方面表现优异,且推理速度快。然而,异常分类——区分不同类型的异常——仍缺乏深入研究,尽管这对实际质检任务至关重要。为此,我们提出VELM,一种基于大语言模型的异常分类新框架。为保证推理速度,先使用无监督异常检测方法作为视觉专家评估样本是否正常;若检测到异常,则由大模型进行类型分类。现有数据集缺乏精确的异常类别标注,成为模型开发与评估的主要障碍。为此,我们构建了MVTec-AC和VisA-AC,分别是MVTec-AD和VisA数据集的精细化版本,包含准确的异常类别标签,支持严格评估。我们的方法在MVTec-AD上实现80.4%的异常分类准确率,较先前基线提升5%;在MVTec-AC上达到84%,证明了VELM在理解与分类异常方面的有效性。我们希望该方法与基准能推动异常分类领域的进一步研究,弥合检测与全面异常表征之间的差距。

原文摘要 · Abstract (English)

Recent advances in visual industrial anomaly detection have demonstrated exceptional performance in identifying and segmenting anomalous regions while maintaining fast inference speeds. However, anomaly classification-distinguishing different types of anomalies-remains largely unexplored despite its critical importance in real-world inspection tasks. To address this gap, we propose VELM, a novel LLM-based pipeline for anomaly classification. Given the critical importance of inference speed, we first apply an unsupervised anomaly detection method as a vision expert to assess the normality of an observation. If an anomaly is detected, the LLM then classifies its type. A key challenge in developing and evaluating anomaly classification models is the lack of precise annotations of anomaly classes in existing datasets. To address this limitation, we introduce MVTec-AC and VisA-AC, refined versions of the widely used MVTec-AD and VisA datasets, which include accurate anomaly class labels for rigorous evaluation. Our approach achieves a state-of-the-art anomaly classification accuracy of 80.4% on MVTec-AD, exceeding the prior baselines by 5%, and 84% on MVTec-AC, demonstrating the effectiveness of VELM in understanding and categorizing anomalies. We hope our methodology and benchmark inspire further research in anomaly classification, helping bridge the gap between detection and comprehensive anomaly characterization.

异常检测大模型工业质检多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。