用分类器特征空间评估扩散模型生成差异,提升异常检测准确率
Beyond Perceptual Distance: Discrepancy Assessment on Deep Representation for Out-of-Distribution Detection with Diffusion Model
- 利用分类器的深层特征与输出逻辑,量化输入与生成图像的差异
- 在ImageNet-1K上优于现有基于扩散模型和非扩散模型的方法
- 适合需要高精度异常检测的工业视觉系统应用
Out-of-Distribution(OoD)检测旨在判断输入样本是否来自受保护分类器的训练分布(In-Distribution, InD),或来自未知分布。近期研究利用扩散模型(DMs)进行OoD检测,因其强大的分布建模能力。给定一张输入图像,预训练于InD数据的扩散模型会生成对应的InD对齐样本,作为生成参考进行对比。然而,现有方法通常在原始图像空间中通过视觉距离评估差异,可能与OoD检测相关的分布差异不一致。本文探究扩散模型基OoD检测中的差异评估本质,提出应如何构建差异度量,以及在何种表示空间和度量方式下进行。为此,我们提出一种以分类器为参照的差异评估方法,利用分类器在InD数据上训练所编码的任务相关知识。具体地,我们量化两类差异:深层特征表示中的协变量差异,以及输出逻辑中的概念差异,有效区分InD与OoD样本。此外,设计子空间策略优化扩散模型生成表示,提升差异评估效果。上述设计构成新框架DDR。在挑战性大规模ImageNet-1K数据集上的实验表明,DDR在检测性能上显著优于多种基于扩散模型与非扩散模型的方法。
原文摘要 · Abstract (English)
Out-of-Distribution (OoD) detection aims to justify whether a given sample is from the training distribution of the classifier-under-protection, i.e., In-Distribution (InD), or from an unknown out distribution. Recent researches have leveraged Diffusion Models (DMs) for OoD detection due to their powerful distribution modeling capability. Given an input image, an InD-pretrained DM produces a corresponding InD-aligned counterpart, which serves as a generative reference for comparison. However, existing DM-based methods typically assess this underlying discrepancy through visual-level distances in the raw image space, which may be misaligned with the distributional discrepancy relevant to OoD detection. In this work, we investigate the fundamentals of discrepancy assessment in DM-based OoD detection, asking how the discrepancy between an input and its DM-generated counterpart should be formulated, and in which representation spaces and with which metrics it should be measured. To this end, we propose to assess the discrepancy in a classifier-relative manner by exploiting the representation spaces of the classifier-under-protection, whose training on InD data encodes rich task-relevant InD knowledge. In particular, we quantify two types of discrepancy: feature-level covariate discrepancy in deep feature representations and logit-level concept discrepancy in output logits, enabling effective differentiation between InD and OoD samples. Moreover, a subspace-based strategy is devised to refine representations of the DM generation to promote discrepancy assessment. Together, these designs form our novel detection framework, namely DDR. Extensive experiments on the challenging large-scale ImageNet-1K dataset demonstrate the superior detection performance of DDR over both DM-based and non-DM-based methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。