arXiv:2503.06661cs.CVcs.AI2025-03CVPR被引 131

让CLIP模型学会识别异常,提升零样本异常检测效果。

AA-CLIP: Enhancing Zero-shot Anomaly Detection via Anomaly-Aware CLIP

论文配图:AA-CLIP: Enhancing Zero-shot Anomaly Detection via Anomaly-Aware CLIP
图 1 · 摘自论文原文
  • 用异常感知的文本锚点增强CLIP在语义空间的区分能力。
  • 通过残差适配器渐进式调整,实现精准异常定位。
  • 适用于工业和医疗领域的零样本异常检测,效率高且性能领先。

异常检测(AD)用于缺陷和病灶等场景中的离群点识别。尽管CLIP凭借强大的泛化能力在零样本AD任务中展现潜力,但其固有的异常无感知特性导致正常与异常特征区分度有限。为此,本文提出异常感知的CLIP(AA-CLIP),在保持通用性的同时,增强其在文本与视觉空间中的异常判别能力。方法采用两阶段策略:首先构建异常感知的文本锚点以清晰区分正常与异常语义;随后将图像块级视觉特征与这些锚点对齐,实现精确异常定位。借助残差适配器,该策略以可控方式逐步适应CLIP,既有效提升异常检测性能,又保留其类别知识。大量实验验证,AA-CLIP是资源高效的零样本异常检测解决方案,在工业与医学应用中均达到当前最优效果。代码已开源。

原文摘要 · Abstract (English)

Anomaly detection (AD) identifies outliers for applications like defect and lesion detection. While CLIP shows promise for zero-shot AD tasks due to its strong generalization capabilities, its inherent Anomaly-Unawareness leads to limited discrimination between normal and abnormal features. To address this problem, we propose Anomaly-Aware CLIP (AA-CLIP), which enhances CLIP's anomaly discrimination ability in both text and visual spaces while preserving its generalization capability. AA-CLIP is achieved through a straightforward yet effective two-stage approach: it first creates anomaly-aware text anchors to differentiate normal and abnormal semantics clearly, then aligns patch-level visual features with these anchors for precise anomaly localization. This two-stage strategy, with the help of residual adapters, gradually adapts CLIP in a controlled manner, achieving effective AD while maintaining CLIP's class knowledge. Extensive experiments validate AA-CLIP as a resource-efficient solution for zero-shot AD tasks, achieving state-of-the-art results in industrial and medical applications. The code is available at https://github.com/Mwxinnn/AA-CLIP.

异常检测CLIP零样本视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。