arXiv:2506.18544cs.CV2025-06被引 1

用正常样本语义先验引导重建,提升图像异常检测精度

Normality Prior Guided Multi-Semantic Fusion Network for Unsupervised Image Anomaly Detection

  • 引入正常样本的多语义特征作为重建先验
  • 在MVTec LOCO AD上像素级性能提升5.7%,图像级提升2.6%
  • 适合无监督异常检测、尤其逻辑类异常场景

当前图像异常检测面临逻辑异常识别更难的挑战。传统编码器-解码器方法依赖低维瓶颈压缩,但神经网络的泛化能力会使逻辑异常的全局语义仍能通过瓶颈传播,导致解码器生成高保真异常重建。为此,本文提出一种基于正常性先验的多语义融合网络。首先利用预训练视觉-语言模型提取正常样本的抽象全局语义,再通过向量量化构建可学习的语义代码本存储典型正常特征;最后将多语义特征融合输入解码器,引导异常重建逼近正常模式。大量实验表明,该方法在MVTec LOCO AD数据集上达到新基准,像素级sPRO提升5.7%,图像级AUROC提升2.6%。源代码已开源。

原文摘要 · Abstract (English)

Recently, detecting logical anomalies is becoming a more challenging task compared to detecting structural ones. Existing encoder decoder based methods typically compress inputs into low-dimensional bottlenecks on the assumption that the compression process can effectively suppress the transmission of logical anomalies to the decoder. However, logical anomalies present a particular difficulty because, while their local features often resemble normal semantics, their global semantics deviate significantly from normal patterns. Thanks to the generalisation capabilities inherent in neural networks, these abnormal semantic features can propagate through low-dimensional bottlenecks. This ultimately allows the decoder to reconstruct anomalous images with misleading fidelity. To tackle the above challenge, we propose a novel normality prior guided multi-semantic fusion network for unsupervised anomaly detection. Instead of feeding the compressed bottlenecks to the decoder directly, we introduce the multi-semantic features of normal samples into the reconstruction process. To this end, we first extract abstract global semantics of normal cases by a pre-trained vision-language network, then the learnable semantic codebooks are constructed to store representative feature vectors of normal samples by vector quantisation. Finally, the above multi-semantic features are fused and employed as input to the decoder to guide the reconstruction of anomalies to approximate normality. Extensive experiments are conducted to validate the effectiveness of our proposed method, and it achieves the SOTA performance on the MVTec LOCO AD dataset with improvements of 5.7% in pixel-sPRO and 2.6% in image-AUROC. The source code is available at https://github.com/Xmh-L/NPGMF.

异常检测无监督学习语义融合视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。