用扩散模型在特征空间做似然检测,效果媲美顶尖方法
Revisiting Likelihood-Based Out-of-Distribution Detection by Modeling Representations
- 在预训练编码器的特征空间计算似然值
- 在CIFAR-10/100上达到98.2%和95.7%的检测准确率
- 适合需要可靠异常检测的高安全场景
分布外(OOD)检测对保障深度学习系统可靠性至关重要,尤其在安全敏感应用中。以往基于似然的生成模型常因在图像数据上将分布外样本赋予更高似然值而受质疑。本文证明似然本身并非缺陷,而是图像空间特性限制了其有效性。通过使用扩散模型的概率流公式构建精确似然估计器,我们在预训练编码器的特征空间中实现与当前最优方法相当的检测性能。实验表明,在CIFAR-10和CIFAR-100上,该方法分别达到98.2%和95.7%的检测准确率。代码已公开于https://github.com/limchaos/Likelihood-OOD.git。
原文摘要 · Abstract (English)
Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their unsatisfactory performance in OOD detection, often assigning higher likelihood to OOD data than in-distribution samples when applied to image data. In this work, we demonstrate that likelihood is not inherently flawed. Rather, several properties in the images space prohibit likelihood as a valid detection score. Given a sufficiently good likelihood estimator, specifically using the probability flow formulation of a diffusion model, we show that likelihood-based methods can still perform on par with state-of-the-art methods when applied in the representation space of pre-trained encoders. The code of our work can be found at $\href{https://github.com/limchaos/Likelihood-OOD.git}{\texttt{https://github.com/limchaos/Likelihood-OOD.git}}$.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。