arXiv:2608.23723cs.CV2026-08中稿 · ACM Multimedia 202…

让文本描述随图像局部特征动态调整,提升工业缺陷检测精度

DriftAD: Visually-Guided Text Drift for Few-Shot Industrial Anomaly Detection

论文配图:DriftAD: Visually-Guided Text Drift for Few-Shot Industrial Anomaly Detection
图 1 · 摘自论文原文
  • 用视觉信息动态修改文本嵌入,实现局部自适应匹配
  • 在1/2/4样本下均超越现有方法,像素级检测准确率超90%
  • 适合小样本工业质检场景,尤其缺陷分布不均时

少样本异常检测(FSAD)近年受益于视觉-语言模型(如CLIP),通过将视觉特征与正常/异常的文本描述对齐实现检测。但现有方法多采用固定文本提示,在整个特征层级和空间维度上统一使用,难以捕捉工业缺陷的高度局部化和尺度依赖性。为此,我们提出DriftAD框架,包含三个核心模块:首先,异常信号增强(ASA)模块通过空间与频域分支强化微弱缺陷信号;其次,视觉引导文本漂移(VGTD)动态变换冻结的CLIP文本嵌入,生成基于各编码深度局部视觉上下文的层间、空间自适应异常描述;第三,漂移引导空间门控(DGSG)利用漂移后的异常描述作为空间探针,选择性增强异常相关视觉特征。此外,漂移分离损失防止漂移描述符表征坍缩,门控监督损失确保DGSG的空间判别性。在MVTec-AD和VisA数据集上的大量实验表明,该方法在所有1、2、4样本设置下,图像级与像素级指标均达当前最优。代码已开源。

原文摘要 · Abstract (English)

Few-shot anomaly detection (FSAD) has recently benefited from vision-language models such as CLIP, which enable anomaly de?tection by aligning visual features with text descriptions of normal and abnormal states. However, existing methods typically rely on static text prompts that are applied uniformly across the entire feature hierarchy and spatial dimensions. This rigid global-to-local matching fails to capture the highly localized and scale-dependent physical variations of industrial defects. To address this, we propose DriftAD, a FSAD framework built on three key modules. First, an Anomaly Signal Amplification (ASA) module enhances subtle defect signals through spatial and frequency branches before text-visual matching. Second, Visually-Guided Text Drift (VGTD) dynamically transforms frozen CLIP text embeddings, steering them into layer?wise, spatially-adaptive anomaly descriptors conditioned on local visual context at each encoder depth. Third, Drift-Guided Spatial Gating (DGSG) uses the drifted abnormal descriptor as a spatial probe to selectively enhance anomaly-relevant visual features. Addi?tionally, a drift separation loss prevents representational collapse of the drifted descriptors, and a gate supervision loss enforces spatially discriminative gating in DGSG. Extensive experiments on MVTec?AD and VisA demonstrate state-of-the-art performance across all 1-, 2-, and 4-shot settings on both image-level and pixel-level metrics. Code is available at https://github.com/wenyang001/DriftAD.

异常检测少样本学习视觉语言模型工业质检

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。