用序列建模增强重建时的上下文感知,提升无监督异常检测效果
Context Enhancement with Reconstruction as Sequence for Unified Unsupervised Anomaly Detection
- 将特征重建视为序列任务,利用Transformer捕捉图像区域间空间关系
- 引入RASFormer块,显著提升重建过程中的上下文依赖性与准确性
- 在多类数据上表现优异,适合需要统一模型的工业异常检测场景
无监督异常检测旨在仅使用正常样本训练出能泛化到未见异常的鲁棒模型。近期研究聚焦于统一无监督检测框架,即单一模型处理所有类别(n类1模型范式)。基于特征重建的方法在此场景下表现最佳。然而,现有方法常因缺乏足够的上下文感知能力,影响重建质量。为此,本文提出一种新颖的重建序列化方法(Reconstruction as Sequence, RAS),从序列建模角度增强特征重建中的上下文对应关系。具体地,基于Transformer结构设计专用RASFormer模块,以捕捉图像不同区域间的空间关联,并强化重建过程中的序列依赖性。通过集成RASFormer,RAS方法显著提升了上下文感知能力,实验表明其性能显著优于现有方法,充分验证了方法的有效性与优越性。代码已开源:https://github.com/Nothingtolose9979/RAS。
原文摘要 · Abstract (English)
Unsupervised anomaly detection (AD) aims to train robust detection models using only normal samples, while can generalize well to unseen anomalies. Recent research focuses on a unified unsupervised AD setting in which only one model is trained for all classes, i.e., n-class-one-model paradigm. Feature-reconstruction-based methods achieve state-of-the-art performance in this scenario. However, existing methods often suffer from a lack of sufficient contextual awareness, thereby compromising the quality of the reconstruction. To address this issue, we introduce a novel Reconstruction as Sequence (RAS) method, which enhances the contextual correspondence during feature reconstruction from a sequence modeling perspective. In particular, based on the transformer technique, we integrate a specialized RASFormer block into RAS. This block enables the capture of spatial relationships among different image regions and enhances sequential dependencies throughout the reconstruction process. By incorporating the RASFormer block, our RAS method achieves superior contextual awareness capabilities, leading to remarkable performance. Experimental results show that our RAS significantly outperforms competing methods, well demonstrating the effectiveness and superiority of our method. Our code is available at https://github.com/Nothingtolose9979/RAS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。