用空间自回归模型捕捉图像块间关系,实现高效无监督异常检测。
Spatial Autoregressive Modeling of DINOv3 Embeddings for Unsupervised Anomaly Detection
- 基于2D自回归模型显式建模图像块间的空间依赖
- 在BMAD和VisA数据集上达到领先性能,推理速度提升3倍以上
- 无需存储特征或原型,适合资源受限场景部署
DINO模型提供丰富的图像块级表征,近年在无监督异常检测(UAD)中表现优异。现有方法通常独立处理正常图像的图像块嵌入,忽略块间空间与邻域关系,隐含假设自注意力与位置编码已充分捕获上下文信息。此外,标准分布常通过记忆库或原型表示建模,需存储大量特征并在推理时进行昂贵比较,导致显著内存与计算开销。本文提出显式使用二维自回归(AR)模型建模图像块嵌入间的空间与上下文依赖,采用轻量级参数化模型替代传统存储方式。通过卷积AR网络学习标准分布,测试时仅需一次前向传播,实现快速且低内存的推理。在包含三个医学影像数据集的BMAD基准与12类工业物体的VisA数据集上评估,结果表明该方法在保持竞争力性能的同时,显著降低推理时间与内存消耗。代码已开源。
原文摘要 · Abstract (English)
DINO models provide rich patch-level representations that have recently enabled strong performance in unsupervised anomaly detection (UAD). Most existing methods extract patch embeddings from normal images and model them independently, ignoring spatial and neighborhood relationships between patches. This implicitly assumes that self-attention and positional encodings sufficiently encode contextual information within each patch embedding. In addition, the normative distribution is often modeled as memory banks or prototype-based representations, which require storing large numbers of features and performing costly comparisons at inference time, leading to substantial memory and computational overhead. In this work, we explicitly model spatial and contextual dependencies between patch embeddings using a 2D autoregressive (AR) model, allowing us to use a simple and efficient model for normative modeling. Instead of storing embeddings or clustering prototypes, our approach learns a compact parametric model of the normative distribution via an AR convolutional neural network (CNN). At test time, anomaly detection reduces to a single forward pass through the network and enables fast and memory-efficient inference. We evaluate our method on the BMAD benchmark, comprising three medical imaging datasets, and the VisA dataset, comprising 12 industrial object categories, and compare it against existing methods, including recent DINO-based approaches. Experimental results demonstrate that explicitly modeling spatial dependencies achieves competitive anomaly detection performance while substantially reducing inference time and memory requirements. Code is available at the project page: https://eerdil.github.io/spatial-ar-dinov3-uad/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。