arXiv:2409.00942cs.CV2024-09被引 7

用分层向量量化让流模型区分多类正常数据,提升异常检测精度。

VQ-Flow: Taming Normalizing Flows for Multi-Class Anomaly Detection via Hierarchical Vector Quantization

  • 引入分层向量量化,分离不同概念的正常数据模式。
  • 在MVTec AD上实现99.5%检测与98.3%定位的AUROC。
  • 适合需要统一训练多类异常检测的工业场景。

归一化流是一类以建模复杂数据分布著称的概率模型,在无监督异常检测中表现优异。本文探索归一化流在多类异常检测中的潜力,即正常数据包含多个类别但无标签。通过引入向量量化(VQ),我们使流模型能无监督地区分多类正常数据的不同概念,提出一种基于流的统一方法——VQ-Flow。具体地,VQ-Flow利用分层向量量化估计两个相对码本:用于概念区分的概念原型码本(CPC)及其对应的特定概念模式码本(CSPC),用于捕捉各概念的正常模式。流模型基于CSPC中捕获的概念特定模式进行条件建模,能够刻画不同概念的特定正常模式。此外,CPC进一步支持概念感知的分布建模,通过在概念原型上重新参数化的混合高斯分布,忠实模拟复杂的多类正常分布。通过引入向量量化,所提VQ-Flow在统一训练框架下达到当前最优性能,在MVTec AD上实现99.5%(检测)/98.3%(定位)的AUROC。代码已开源。

原文摘要 · Abstract (English)

Normalizing flows, a category of probabilistic models famed for their capabilities in modeling complex data distributions, have exhibited remarkable efficacy in unsupervised anomaly detection. This paper explores the potential of normalizing flows in multi-class anomaly detection, wherein the normal data is compounded with multiple classes without providing class labels. Through the integration of vector quantization (VQ), we empower the flow models to distinguish different concepts of multi-class normal data in an unsupervised manner, resulting in a novel flow-based unified method, named VQ-Flow. Specifically, our VQ-Flow leverages hierarchical vector quantization to estimate two relative codebooks: a Conceptual Prototype Codebook (CPC) for concept distinction and its concomitant Concept-Specific Pattern Codebook (CSPC) to capture concept-specific normal patterns. The flow models in VQ-Flow are conditioned on the concept-specific patterns captured in CSPC, capable of modeling specific normal patterns associated with different concepts. Moreover, CPC further enables our VQ-Flow for concept-aware distribution modeling, faithfully mimicking the intricate multi-class normal distribution through a mixed Gaussian distribution reparametrized on the conceptual prototypes. Through the introduction of vector quantization, the proposed VQ-Flow advances the state-of-the-art in multi-class anomaly detection within a unified training scheme, yielding the Det./Loc. AUROC of 99.5%/98.3% on MVTec AD. The codebase is publicly available at https://github.com/cool-xuan/vqflow.

异常检测归一化流向量量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。