提出原型学习框架,可发现工业场景中多种细微异常类型。
ProtoAnomalyNCD: Prototype Learning for Multi-class Novel Anomaly Discovery in Industrial Scenarios
- 用文本提示定位物体区域,结合异常图引导注意力
- 在多个数据集上实现优于现有方法的多类异常发现性能
- 适合需要识别未知异常类型的工业质检场景
现有工业异常检测方法主要判断是否存在异常,但实际应用还需发现并分类多种异常类型。由于工业异常语义细微,且现有方法未能充分利用图像先验,直接聚类效果不佳。为此,我们提出基于原型学习的ProtoAnomalyNCD框架,可与多种异常检测方法集成,用于发现未见的多类型异常。首先,利用带文本提示的Grounded SAM定位物体区域,作为异常分类网络的先验;其次,针对异常常表现为产品上的细微、细粒度模式,设计了异常图引导注意力模块,引入区域引导因子,帮助注意力模块区分背景、物体区域和异常区域。通过联合使用局部化产品区域和异常图作为先验,该模块增强异常特征,抑制背景噪声,同时保留正常特征以支持对比学习。最终,在统一的原型学习框架下,ProtoAnomalyNCD 实现未见异常类别的发现与聚类,并支持多类型异常分类。进一步扩展至未见离群点检测,实现任务层面统一。在MVTec AD、MTD和Real-IAD数据集上均优于当前最优方法。
原文摘要 · Abstract (English)
Existing industrial anomaly detection methods mainly determine whether an anomaly is present. However, real-world applications also require discovering and classifying multiple anomaly types. Since industrial anomalies are semantically subtle and current methods do not sufficiently exploit image priors, direct clustering approaches often perform poorly. To address these challenges, we propose ProtoAnomalyNCD, a prototype-learning-based framework for discovering unseen anomaly classes of multiple types that can be integrated with various anomaly detection methods. First, to suppress background clutter, we leverage Grounded SAM with text prompts to localize object regions as priors for the anomaly classification network. Next, because anomalies usually appear as subtle and fine-grained patterns on the product, we introduce an Anomaly-Map-Guided Attention block. Within this block, we design a Region Guidance Factor that helps the attention module distinguish among background, object regions, and anomalous regions. By using both localized product regions and anomaly maps as priors, the module enhances anomalous features while suppressing background noise and preserving normal features for contrastive learning. Finally, under a unified prototype-learning framework, ProtoAnomalyNCD discovers and clusters unseen anomaly classes while simultaneously enabling multi-type anomaly classification. We further extend our method to detect unseen outliers, achieving task-level unification. Our method outperforms state-of-the-art approaches on the MVTec AD, MTD, and Real-IAD datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。