arXiv:2510.11028cs.CV2025-10中稿 · PRCV被引 8

用CLIP和SAM协作,让模型更准定位工业缺陷。

Enhancing Zero-Shot Anomaly Detection: CLIP-SAM Collaboration with Cascaded Prompts

  • 用双模型协同生成正负点提示,引导分割聚焦异常区域。
  • 通过级联提示与轻量解码器,显著提升边界精度并去噪。
  • 在Visa数据集上F1-max和AP分别领先10.3%和7.7%,适合工业质检场景。

近期,基础模型强大的泛化能力为零样本异常分割任务带来了新方案。然而,如何正确引导这些模型完成下游任务仍具挑战。本文提出一种两阶段框架,用于工业异常检测中的零样本异常分割。该框架充分结合了CLIP的异常定位能力和SAM的边界感知能力。(1) 为缓解SAM对完整物体分割的倾向,提出协同特征点提示生成(PPG)模块,联合使用CLIP与SAM生成正负点提示,引导SAM关注异常区域而非整个物体。(2) 为进一步优化分割结果并减少粗糙边界与孤立噪声,引入针对SAM的级联提示(CPS)模块,采用混合提示与轻量解码器级联,实现对异常区域的精确分割。多数据集实验验证表明,本方法在零样本异常分割任务中达到当前最优性能。尤其在Visa数据集上,F1-max与AP指标分别优于现有方法10.3%和7.7%。

原文摘要 · Abstract (English)

Recently, the powerful generalization ability exhibited by foundation models has brought forth new solutions for zero-shot anomaly segmentation tasks. However, guiding these foundation models correctly to address downstream tasks remains a challenge. This paper proposes a novel two-stage framework, for zero-shot anomaly segmentation tasks in industrial anomaly detection. This framework excellently leverages the powerful anomaly localization capability of CLIP and the boundary perception ability of SAM.(1) To mitigate SAM's inclination towards object segmentation, we propose the Co-Feature Point Prompt Generation (PPG) module. This module collaboratively utilizes CLIP and SAM to generate positive and negative point prompts, guiding SAM to focus on segmenting anomalous regions rather than the entire object. (2) To further optimize SAM's segmentation results and mitigate rough boundaries and isolated noise, we introduce the Cascaded Prompts for SAM (CPS) module. This module employs hybrid prompts cascaded with a lightweight decoder of SAM, achieving precise segmentation of anomalous regions. Across multiple datasets, consistent experimental validation demonstrates that our approach achieves state-of-the-art zero-shot anomaly segmentation results. Particularly noteworthy is our performance on the Visa dataset, where we outperform the state-of-the-art methods by 10.3\% and 7.7\% in terms of {$F_1$-max} and AP metrics, respectively.

异常检测CLIPSAM零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。