通过动态选择提示词提升零样本异常检测在新场景下的表现
Zero-Shot Anomaly Detection with Dual-Branch Prompt Selection
- 双分支提示学习:融合可学习提示与语义属性,自适应选择关键异常特征
- 无标签测试时自适应:用高置信度伪标签更新提示参数,提升泛化能力
- 适用于工业和医疗领域,尤其适合无标注数据的异常检测任务
零样本异常检测(ZSAD)仅依赖通用特征,无需异常样本标签即可识别和定位未见类别的缺陷。然而,现有方法因训练数据局限于有限领域,在面对领域偏移时表现不佳。本文提出PILOT框架,包含两项创新:(1) 双分支提示学习机制,动态融合可学习提示与结构化语义属性,使模型能为每张输入图像自适应加权最相关异常线索;(2) 无标签测试时自适应策略,利用未标注测试数据中的高置信度伪标签更新可学习提示参数。在13个工业与医疗基准上的大量实验表明,PILOT在领域偏移条件下实现了异常检测与定位的最新性能。
原文摘要 · Abstract (English)
Zero-shot anomaly detection (ZSAD) enables identifying and localizing defects in unseen categories by relying solely on generalizable features rather than requiring any labeled examples of anomalies. However, existing ZSAD methods, whether using fixed or learned prompts, struggle under domain shifts because their training data are derived from limited training domains and fail to generalize to new distributions. In this paper, we introduce PILOT, a framework designed to overcome these challenges through two key innovations: (1) a novel dual-branch prompt learning mechanism that dynamically integrates a pool of learnable prompts with structured semantic attributes, enabling the model to adaptively weight the most relevant anomaly cues for each input image; and (2) a label-free test-time adaptation strategy that updates the learnable prompt parameters using high-confidence pseudo-labels from unlabeled test data. Extensive experiments on 13 industrial and medical benchmarks demonstrate that PILOT achieves state-of-the-art performance in both anomaly detection and localization under domain shift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。