arXiv:2410.10289cs.CV2024-10ICCV被引 32

通过细粒度异常提示学习,提升零样本异常检测的精准度。

Fine-grained Abnormality Prompt Learning for Zero-shot Anomaly Detection

  • 分解异常语义,学习多样化细粒度提示
  • 在19个真实数据集上显著优于现有方法
  • 适合工业缺陷与医学异常检测场景

当前零样本异常检测(ZSAD)方法利用大规模预训练视觉-语言模型,在无需特定数据训练或示例的情况下实现异常检测。然而,这些方法通常仅关注捕捉粗粒度异常语义,如‘损坏’、‘不完美’或‘缺陷’等高层概念,难以识别偏离通用异常模式的多样细节。为此,本文提出FAPrompt框架,通过引入复合异常提示学习(CAP)模块,学习一组互补且分解的异常提示,使提示能够建模源自同一正常语义的多种异常模式。同时,为增强跨数据集泛化能力,引入数据相关异常先验学习(DAP)模块,从每个测试图像的异常特征中学习样本级异常先验,动态适配异常提示。在涵盖工业缺陷与医学异常的19个真实世界数据集上的综合实验表明,FAPrompt在图像级和像素级ZSAD任务中均显著优于现有先进方法。代码已开源:https://github.com/mala-lab/FAPrompt。

原文摘要 · Abstract (English)

Current zero-shot anomaly detection (ZSAD) methods show remarkable success in prompting large pre-trained vision-language models to detect anomalies in a target dataset without using any dataset-specific training or demonstration. However, these methods often focus on crafting/learning prompts that capture only coarse-grained semantics of abnormality, e.g., high-level semantics like "damaged", "imperfect", or "defective" objects. They therefore have limited capability in recognizing diverse abnormality details that deviate from these general abnormal patterns in various ways. To address this limitation, we propose FAPrompt, a novel framework designed to learn Fine-grained Abnormality Prompts for accurate ZSAD. To this end, a novel Compound Abnormality Prompt learning (CAP) module is introduced in FAPrompt to learn a set of complementary, decomposed abnormality prompts, where abnormality prompts are enforced to model diverse abnormal patterns derived from the same normality semantic. On the other hand, the fine-grained abnormality patterns can be different from one dataset to another. To enhance the cross-dataset generalization, another novel module, namely Data-dependent Abnormality Prior learning (DAP), is introduced in FAPrompt to learn a sample-wise abnormality prior from abnormal features of each test image to dynamically adapt the abnormality prompts to individual test images. Comprehensive experiments on 19 real-world datasets, covering both industrial defects and medical anomalies, demonstrate that FAPrompt substantially outperforms state-of-the-art methods in both image- and pixel-level ZSAD tasks. Code is available at https://github.com/mala-lab/FAPrompt.

异常检测零样本提示学习细粒度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。