arXiv:2603.18290cs.AI2026-03

提出CORE方法,通过分离置信度与残差信号提升分布外检测鲁棒性。

CORE: Robust Out-of-Distribution Detection via Confidence and Orthogonal Residual Scoring

  • 分解特征为置信度与残差两个正交子空间,独立评分
  • 在五个架构五种配置下表现稳定,三项第一,平均AUROC最高
  • 计算开销极小,适合实际部署

分布外(OOD)检测对可靠部署深度学习模型至关重要,但现有方法在不同架构和数据集上表现不一——某方法在一项基准领先,却在另一项失效。我们发现其根源在于结构缺陷:基于logit的方法仅依赖分类器置信度信号,而基于特征的方法在完整特征空间中衡量训练分布成员资格时,置信度与成员资格纠缠,继承了对架构敏感的失败模式。我们观察到,倒数第二层特征天然可分解为两个正交子空间:一个与分类器对齐、编码置信度,另一个是分类器丢弃的残差。我们发现该残差携带了类特定的方向性签名,是分布内数据的成员信号,对logit方法不可见,且在特征方法中易被噪声掩盖。我们提出CORE(COnfidence + REsidual),通过独立评分两个子空间并归一化相加来解耦信号。由于两信号正交,其失败模式近似独立,在任一信号不可靠时仍能保持鲁棒。CORE在五种架构与五种基准配置中达到竞争性或最先进性能,三项排名第一,整体平均AUROC最高,计算开销可忽略。

原文摘要 · Abstract (English)

Out-of-distribution (OOD) detection is essential for deploying deep learning models reliably, yet no single method performs consistently across architectures and datasets -- a scorer that leads on one benchmark often falters on another. We attribute this inconsistency to a shared structural limitation: logit-based methods see only the classifier's confidence signal, while feature-based methods attempt to measure membership in the training distribution but do so in the full feature space where confidence and membership are entangled, inheriting architecture-sensitive failure modes. We observe that penultimate features naturally decompose into two orthogonal subspaces: a classifier-aligned component encoding confidence, and a residual the classifier discards. We discover that this residual carries a class-specific directional signature for in-distribution data -- a membership signal invisible to logit-based methods and entangled with noise in feature-based methods. We propose CORE (COnfidence + REsidual), which disentangles the two signals by scoring each subspace independently and combines them via normalized summation. Because the two signals are orthogonal by construction, their failure modes are approximately independent, producing robust detection where either view alone is unreliable. CORE achieves competitive or state-of-the-art performance across five architectures and five benchmark configurations, ranking first in three of five settings and achieving the highest grand average AUROC with negligible computational overhead.

OOD检测特征分解正交性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。