用生成模型检测图像数据的分布偏移,识别异常信号。
Can Your Generative Model Detect Out-of-Distribution Covariate Shift?
- 基于条件归一化流建模高频图像特征,捕捉分布变化
- 在CIFAR10-C和ImageNet200-C上实现高精度检测
- 适用于提升成像系统可靠性与模型鲁棒性
检测分布外(OOD)感官数据与协变量分布偏移的目标是识别测试样本中与正常、分布内(ID)数据在高层图像统计上不同的情况。现有研究主要关注语义偏移,对协变量偏移缺乏共识。生成模型通过无监督方式学习ID数据分布,可有效识别显著偏离该分布的样本,且不依赖下游任务。本文通过大量实验分析多种模型,阐明生成模型检测领域特定协变量偏移的能力。我们提出一种新方法CovariateFlow,专门针对协变量异方差的高频图像成分,利用条件归一化流(cNFs)进行建模。在CIFAR10 vs. CIFAR10-C和ImageNet200 vs. ImageNet200-C上的结果表明,该方法能准确检测出协变量偏移。本工作有助于提升成像系统保真度,并增强机器学习模型在协变量偏移下的分布外检测能力。
原文摘要 · Abstract (English)
Detecting Out-of-Distribution (OOD) sensory data and covariate distribution shift aims to identify new test examples with different high-level image statistics to the captured, normal and In-Distribution (ID) set. Existing OOD detection literature largely focuses on semantic shift with little-to-no consensus over covariate shift. Generative models capture the ID data in an unsupervised manner, enabling them to effectively identify samples that deviate significantly from this learned distribution, irrespective of the downstream task. In this work, we elucidate the ability of generative models to detect and quantify domain-specific covariate shift through extensive analyses that involves a variety of models. To this end, we conjecture that it is sufficient to detect most occurring sensory faults (anomalies and deviations in global signals statistics) by solely modeling high-frequency signal-dependent and independent details. We propose a novel method, CovariateFlow, for OOD detection, specifically tailored to covariate heteroscedastic high-frequency image-components using conditional Normalizing Flows (cNFs). Our results on CIFAR10 vs. CIFAR10-C and ImageNet200 vs. ImageNet200-C demonstrate the effectiveness of the method by accurately detecting OOD covariate shift. This work contributes to enhancing the fidelity of imaging systems and aiding machine learning models in OOD detection in the presence of covariate shift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。