arXiv:2508.13560cs.CV2025-08ICCV被引 11

无需微调,仅用几张正常图像就能识别未知类别的异常区域。

DictAS: A Framework for Class-Generalizable Few-Shot Anomaly Segmentation via Dictionary Lookup

  • 用正常样本构建视觉字典,通过稀疏查找匹配异常区域。
  • 在7个工业与医疗数据集上超越现有最佳方法,平均性能提升显著。
  • 适合无标注数据、需快速部署的工业质检与医学影像场景。

近期视觉-语言模型(如CLIP)在少样本异常分割(FSAS)任务中展现出对未见类别的强泛化能力,依赖于对真实已见异常样本的先验知识。本文提出新框架DictAS,使统一模型在无需目标数据微调的情况下,仅通过少量正常参考图像作为视觉提示,即可检测未知类别中的视觉异常。核心思想是通过自监督学习将字典查找能力迁移到FSAS任务,而非简单记忆训练集中的正负特征模式。DictAS包含三部分:(1) 字典构建——利用正常参考图像特征模拟真实字典的索引与内容;(2) 字典查找——通过稀疏策略从字典中检索查询区域特征,无法匹配则判定为异常;(3) 查询判别正则化——通过对比查询约束和文本对齐约束增强异常判别力。在七个公开工业与医疗数据集上的实验表明,DictAS持续优于当前最优方法。

原文摘要 · Abstract (English)

Recent vision-language models (e.g., CLIP) have demonstrated remarkable class-generalizable ability to unseen classes in few-shot anomaly segmentation (FSAS), leveraging supervised prompt learning or fine-tuning on seen classes. However, their cross-category generalization largely depends on prior knowledge of real seen anomaly samples. In this paper, we propose a novel framework, namely DictAS, which enables a unified model to detect visual anomalies in unseen object categories without any retraining on the target data, only employing a few normal reference images as visual prompts. The insight behind DictAS is to transfer dictionary lookup capabilities to the FSAS task for unseen classes via self-supervised learning, instead of merely memorizing the normal and abnormal feature patterns from the training set. Specifically, DictAS mainly consists of three components: (1) Dictionary Construction - to simulate the index and content of a real dictionary using features from normal reference images. (2) Dictionary Lookup - to retrieve queried region features from the dictionary via a sparse lookup strategy. When a query feature cannot be retrieved, it is classified as an anomaly. (3) Query Discrimination Regularization - to enhance anomaly discrimination by making abnormal features harder to retrieve from the dictionary. To achieve this, Contrastive Query Constraint and Text Alignment Constraint are further proposed. Extensive experiments on seven public industrial and medical datasets demonstrate that DictAS consistently outperforms state-of-the-art FSAS methods.

异常检测少样本学习字典查找视觉-语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。