arXiv:2506.09399cs.CV2025-06ICML被引 5

动态调整协方差矩阵,提升模型对分布外数据的识别能力。

Improving Out-of-Distribution Detection via Dynamic Covariance Calibration

  • 实时根据输入特征动态更新先验协方差矩阵
  • 在残差空间内调整,避免主成分方向被干扰
  • 在CIFAR和ImageNet-1k上显著提升多种模型的检测效果

分布外(OOD)检测对保障AI系统可靠性至关重要。基于子空间的方法利用信息几何提取距离度量,在检测分布外数据方面表现良好,但其静态从训练分布中提取信息几何的局限性,无法应对不良分布样本带来的几何失真。本文提出,通过动态响应新数据调整先验几何,可校正此类影响。为此,我们设计一种新方法:基于实时输入特征动态更新先验协方差矩阵,通过减小输入特征方向上的协方差并限制调整仅在残差空间内进行,从而保留核心数据特征,避免主成分空间中不必要方向的扰动。我们在两个预训练模型上评估CIFAR数据集,以及五个ImageNet-1k预训练模型(包括自监督DINO模型)的表现。大量实验表明,该方法在多种模型下均显著提升OOD检测性能。代码已开源:https://github.com/workerbcd/ooddcc。

原文摘要 · Abstract (English)

Out-of-Distribution (OOD) detection is essential for the trustworthiness of AI systems. Methods using prior information (i.e., subspace-based methods) have shown effective performance by extracting information geometry to detect OOD data with a more appropriate distance metric. However, these methods fail to address the geometry distorted by ill-distributed samples, due to the limitation of statically extracting information geometry from the training distribution. In this paper, we argue that the influence of ill-distributed samples can be corrected by dynamically adjusting the prior geometry in response to new data. Based on this insight, we propose a novel approach that dynamically updates the prior covariance matrix using real-time input features, refining its information. Specifically, we reduce the covariance along the direction of real-time input features and constrain adjustments to the residual space, thus preserving essential data characteristics and avoiding effects on unintended directions in the principal space. We evaluate our method on two pre-trained models for the CIFAR dataset and five pre-trained models for ImageNet-1k, including the self-supervised DINO model. Extensive experiments demonstrate that our approach significantly enhances OOD detection across various models. The code is released at https://github.com/workerbcd/ooddcc.

OOD检测协方差校准动态调整图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。