提升生成模型似然检测效果,让新方法始终优于或匹配原始似然。
Resultant: Incremental Effectiveness on Likelihood for Unsupervised Out-of-Distribution Detection
- 通过缓解隐空间分布不匹配和校准数据熵-互信息关系改进似然检测。
- 在多个基准上实现超越或匹配原始似然的性能,尤其在困难任务中表现优异。
- 适合关注无监督异常检测与生成模型优化的研究者参考。
无监督分布外(U-OOD)检测旨在仅使用未标注的分布内(ID)数据训练检测器来识别分布外(OOD)样本。基于深度生成模型(DGM)估计的似然函数可作为自然检测器,但在一些流行‘难’基准(如以FashionMNIST为ID、MNIST为OOD)上性能受限。近期研究提出了多种基于DGM的检测方法以突破似然限制,但多数方法在某些‘非难’场景(如以SVHN为ID、CIFAR10为OOD)下无法持续超越或匹配似然表现——此时似然本身已接近完美。因此,本文呼吁关注对似然的增量有效性:即新方法是否能在所有场景中始终优于或至少匹配似然。我们首先分析变分DGM的似然行为,发现其性能可通过两个方向提升:(i) 缓解隐空间分布不匹配,(ii) 校准数据集熵与互信息的集成。为此,分别引入后处理先验和数据集熵-互信息校准技术。最终方法Resultant融合这两方向,相较单一技术获得更强的增量有效性。实验表明,Resultant在广泛任务中达到新的SOTA,且始终优于或匹配原始似然。
原文摘要 · Abstract (English)
Unsupervised out-of-distribution (U-OOD) detection is to identify OOD data samples with a detector trained solely on unlabeled in-distribution (ID) data. The likelihood function estimated by a deep generative model (DGM) could be a natural detector, but its performance is limited in some popular "hard" benchmarks, such as FashionMNIST (ID) vs. MNIST (OOD). Recent studies have developed various detectors based on DGMs to move beyond likelihood. However, despite their success on "hard" benchmarks, most of them struggle to consistently surpass or match the performance of likelihood on some "non-hard" cases, such as SVHN (ID) vs. CIFAR10 (OOD) where likelihood could be a nearly perfect detector. Therefore, we appeal for more attention to incremental effectiveness on likelihood, i.e., whether a method could always surpass or at least match the performance of likelihood in U-OOD detection. We first investigate the likelihood of variational DGMs and find its detection performance could be improved in two directions: i) alleviating latent distribution mismatch, and ii) calibrating the dataset entropy-mutual integration. Then, we apply two techniques for each direction, specifically post-hoc prior and dataset entropy-mutual calibration. The final method, named Resultant, combines these two directions for better incremental effectiveness compared to either technique alone. Experimental results demonstrate that the Resultant could be a new state-of-the-art U-OOD detector while maintaining incremental effectiveness on likelihood in a wide range of tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。