让CLIP模型学会识别异常,提升零样本异常检测效果。
AA-CLIP: Enhancing Zero-shot Anomaly Detection via Anomaly-Aware CLIP

- 用异常感知的文本锚点增强CLIP在语义空间的区分能力。
- 通过残差适配器渐进式调整,实现精准异常定位。
- 适用于工业和医疗领域的零样本异常检测,效率高且性能领先。
异常检测(AD)用于缺陷和病灶等场景中的离群点识别。尽管CLIP凭借强大的泛化能力在零样本AD任务中展现潜力,但其固有的异常无感知特性导致正常与异常特征区分度有限。为此,本文提出异常感知的CLIP(AA-CLIP),在保持通用性的同时,增强其在文本与视觉空间中的异常判别能力。方法采用两阶段策略:首先构建异常感知的文本锚点以清晰区分正常与异常语义;随后将图像块级视觉特征与这些锚点对齐,实现精确异常定位。借助残差适配器,该策略以可控方式逐步适应CLIP,既有效提升异常检测性能,又保留其类别知识。大量实验验证,AA-CLIP是资源高效的零样本异常检测解决方案,在工业与医学应用中均达到当前最优效果。代码已开源。
原文摘要 · Abstract (English)
Anomaly detection (AD) identifies outliers for applications like defect and lesion detection. While CLIP shows promise for zero-shot AD tasks due to its strong generalization capabilities, its inherent Anomaly-Unawareness leads to limited discrimination between normal and abnormal features. To address this problem, we propose Anomaly-Aware CLIP (AA-CLIP), which enhances CLIP's anomaly discrimination ability in both text and visual spaces while preserving its generalization capability. AA-CLIP is achieved through a straightforward yet effective two-stage approach: it first creates anomaly-aware text anchors to differentiate normal and abnormal semantics clearly, then aligns patch-level visual features with these anchors for precise anomaly localization. This two-stage strategy, with the help of residual adapters, gradually adapts CLIP in a controlled manner, achieving effective AD while maintaining CLIP's class knowledge. Extensive experiments validate AA-CLIP as a resource-efficient solution for zero-shot AD tasks, achieving state-of-the-art results in industrial and medical applications. The code is available at https://github.com/Mwxinnn/AA-CLIP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。