arXiv:2511.11934cs.LGcs.CV2025-11被引 1

研究不同模型与训练方式下异常检测效果,发现表征质量比评分设计更重要。

A Systematic Analysis of Out-of-Distribution Detection Under Representation and Training Paradigm Shifts

  • 从表征视角系统对比多种异常检测方法,覆盖CNN与ViT模型
  • 简单概率分数在误分类检测中表现最佳,严重偏移时几何感知分数更优
  • 提出基于主成分分析的过滤法和无额外数据的检测器预测方法

本文通过以表征为中心的视角,系统性地评估了分布外(OOD)检测中的各类检测器。研究涵盖CNN与ViT骨干网络、多种训练范式,以及四个图像分类源数据集(CIFAR-10、CIFAR-100、SuperCIFAR-100、TinyImageNet),并基于CLIP衍生语义距离将分布外数据分为近、中、远三类。采用受控多重比较的排序流程,在无需阈值的AURC与AUGRC指标下识别统计上不可区分的顶尖检测器组合。主要发现为:竞争性检测器的表现更依赖于学习到的表征而非分数设计本身。对于CNN,边缘型分数在近域OOD中最强;随着偏移加剧,如NNGuide、fDBD、CTM等几何感知分数更具竞争力。对于微调后的ViT,重建与残差基分数主导顶级组合。通过分析最后一层表征的神经坍缩(NC)度量,揭示了当表征更坍缩且与分类器权重对齐时,原型与边界感知分数更强;反之则梯度与流形基分数更优。基于此,提出两项贡献:一种简单的基于PCA的投影过滤方法可提升检测性能,另一种方法利用训练后分类器的NC测量值预测其最优检测器短名单,无需额外分布外数据。

原文摘要 · Abstract (English)

We present a systematic benchmark of out-of-distribution (OOD) detection CSFs through a representation-centric lens. Our study spans CNN and ViT backbones, multiple training paradigms, four image-classification source datasets (CIFAR-10, CIFAR-100, SuperCIFAR-100, and TinyImageNet), and OOD datasets grouped into near, mid, and far regimes using CLIP-derived semantic distances. To compare CSFs across these settings, we employ a multiple-comparison-controlled rank pipeline that identifies top cliques of statistically indistinguishable winners under threshold-free ranking metrics (AURC and AUGRC). The main empirical finding is that the competitive detector family depends more on the learned representation than on score design alone. For both CNNs and ViTs, simple probabilistic scores dominate misclassification detection. On CNNs, margin-based scores are strongest in near-OOD regimes, while geometry-aware scores such as NNGuide, fDBD, and CTM become more competitive as shift severity increases. On fine-tuned ViTs, the top cliques are led mainly by reconstruction- and residual-based scores. To interpret these ranking shifts, we analyze the last-layer representation using Neural Collapse (NC) metrics. The resulting picture is consistent across architectures: prototype- and boundary-aware scores become stronger when the representation is more collapsed and better aligned with classifier weights, whereas weaker-collapse regimes favor gradient- and manifold-based scores. Building on these insights, we propose two contributions: a simple PCA-based projection-filtering procedure that improves detector performance, and an approach that uses NC measurements computed from a trained classifier to predict its competitive out-of-distribution detector shortlist, without requiring any additional OOD data.

异常检测表征学习深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。