arXiv:2604.02871cs.CV2026-04

用稀疏编码器生成异常检测引导向量,无需微调即可跨类别识别异常。

SPG: Sparse-Projected Guides with Sparse Autoencoders for Zero-Shot Anomaly Detection

  • 在稀疏编码器隐空间学习稀疏引导系数,生成正常与异常的参考向量。
  • 在MVTec AD和VisA数据集上实现高精度像素级分割,像素级AUROC领先。
  • 引导系数可追溯至少量词典原子,揭示通用与类别特异性特征因子。

我们研究使用冻结的基础模型特征进行零样本异常检测与分割,所有可学习参数仅在带标签的辅助数据集上训练,并部署到未见目标类别中,无需目标域适应。现有基于提示的方法使用手工或学习的提示嵌入作为正常/异常状态的参考向量。我们提出稀疏投影引导(SPG),一种无提示框架,在稀疏自编码器(SAE)隐空间中学习稀疏引导系数,通过SAE词典生成正常/异常引导向量。SPG在带标签的辅助数据集上采用两阶段学习策略:(i) 在补丁-标记特征上训练SAE;(ii) 冻结主干网络和SAE,仅优化引导系数并利用辅助像素级掩码。在跨数据集零样本设置下,SPG在MVTec AD和VisA上实现了具有竞争力的图像级检测与强大的像素级分割表现;使用DINOv3时,其像素级AUROC在对比方法中最高。我们还基于OpenCLIP(ViT-L/14@336px)实例化SPG,使主干网络与基于CLIP的基线对齐。此外,学习到的引导系数能回溯至少数词典原子,揭示类别通用与特定因素。

原文摘要 · Abstract (English)

We study zero-shot anomaly detection and segmentation using frozen foundation model features, where all learnable parameters are trained only on a labeled auxiliary dataset and deployed to unseen target categories without any target-domain adaptation. Existing prompt-based approaches use handcrafted or learned prompt embeddings as reference vectors for normal/anomalous states. We propose Sparse-Projected Guides (SPG), a prompt-free framework that learns sparse guide coefficients in the Sparse Autoencoder (SAE) latent space, which generate normal/anomaly guide vectors via the SAE dictionary. SPG employs a two stage learning strategy on the labeled auxiliary dataset: (i) train an SAE on patch-token features, and (ii) optimize only guide coefficients using auxiliary pixel-level masks while freezing the backbone and SAE. On MVTec AD and VisA under cross-dataset zero-shot settings, SPG achieves competitive image-level detection and strong pixel-level segmentation; with DINOv3, SPG attains the highest pixellevel AUROC among the compared methods. We also report SPG instantiated with OpenCLIP (ViT-L/14@336px) to align the backbone with CLIP-based baselines. Moreover, the learned guide coefficients trace decisions back to a small set of dictionary atoms, revealing category-general and category-specific factors.

异常检测稀疏编码零样本图像分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。