arXiv:2510.18342cs.AI2025-10

提出ShortcutBreaker框架,解决多类无监督异常检测中特征复制问题。

ShortcutBreaker: Low-Rank Noisy Bottleneck and Frequency Filtering Block for Multi-Class Unsupervised Anomaly Detection

  • 设计低秩噪声瓶颈,强制特征压缩以阻断身份捷径。
  • 引入全局扰动注意力,提升解码器对异常的敏感性。
  • 在4个工业与医疗数据集上表现领先,图像级AUROC超90%。

多类无监督异常检测(MUAD)因可统一建模多类对象而受到广泛关注,避免为不同物体分别训练模型,显著降低计算开销。尽管基于Transformer的先进架构提升了性能,但身份捷径问题仍存在:输入直接映射至输出,导致正常与异常样本的重建误差差异缩小,难以区分。为此,本文提出ShortcutBreaker,一种面向MUAD的统一特征重构框架,包含两项创新:其一,基于矩阵秩不等式设计低秩噪声瓶颈(LRNB),将高维特征投影至低秩隐空间,理论上可防止平凡的身份复制;其二,利用ViT的全局建模能力,引入全局扰动注意力机制,抑制解码器中的信息捷径。在四个常用异常检测基准上进行大量实验,包括三个工业数据集(MVTec-AD、ViSA、Real-IAD)和一个医疗数据集(Universal Medical),所提方法在图像级别分别取得99.8%、98.9%、90.6%和87.8%的AUROC,全面优于现有MUAD方法。代码将公开。

原文摘要 · Abstract (English)

Multi-class unsupervised anomaly detection (MUAD) has garnered growing research interest, as it seeks to develop a unified model for anomaly detection across multiple classes, i.e., eliminating the need to train separate models for distinct objects and thereby saving substantial computational resources. Under the MUAD setting, while advanced Transformer-based architectures have brought significant performance improvements, identity shortcuts persist: they directly copy inputs to outputs, narrowing the gap in reconstruction errors between normal and abnormal cases, and thereby making the two harder to distinguish. Therefore, we propose ShortcutBreaker, a novel unified feature-reconstruction framework for MUAD tasks, featuring two key innovations to address the issue of shortcuts. First, drawing on matrix rank inequality, we design a low-rank noisy bottleneck (LRNB) to project highdimensional features into a low-rank latent space, and theoretically demonstrate its capacity to prevent trivial identity reproduction. Second, leveraging ViTs global modeling capability instead of merely focusing on local features, we incorporate a global perturbation attention to prevent information shortcuts in the decoders. Extensive experiments are performed on four widely used anomaly detection benchmarks, including three industrial datasets (MVTec-AD, ViSA, and Real-IAD) and one medical dataset (Universal Medical). The proposed method achieves a remarkable image-level AUROC of 99.8%, 98.9%, 90.6%, and 87.8% on these four datasets, respectively, consistently outperforming previous MUAD methods across different scenarios Our code will be released..

异常检测Transformer低秩建模无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。