arXiv:2605.05638cs.LG2026-05

无需微调,大模型冻结表示即可实现精准无标签分布外检测。

Scaling Pretrained Representations Enables Label-Free Out-of-Distribution Detection Without Fine-Tuning

论文配图:Scaling Pretrained Representations Enables Label-Free Out-of-Distribution Detection Without Fine-Tuning
图 1 · 摘自论文原文
  • 利用冻结预训练模型的特征,通过全局与局部两种无标签检测方法。
  • 59组视觉与语言任务中,模型规模越大,检测性能越优且两类方法差距消失。
  • 适合追求高效部署、避免标注成本的研究者与工程师使用。

深度学习模型在输入偏离训练数据分布时往往无法发出预警,导致不可靠预测。以往研究认为有效的分布外(OOD)检测需依赖类别条件建模或有监督微调。我们重新审视现代预训练模型,发现其冻结表示已蕴含足够几何结构,可实现准确的无标签OOD检测。在涵盖视觉与语言的59组骨干网络-任务组合中,我们对比了两种互补的无标签检测器:基于未标记特征的全局马氏距离估计器,以及基于扩散模型的轻量级局部典型性估计器ReSCOPED。尽管机制不同,但表示能力扩展揭示了一致的规律:全局与局部检测器的绝对性能随表示质量提升而改善,且随着骨干模型规模增大,两者性能差距在语言与视觉任务中均消失。结果表明,无标签OOD检测高度依赖冻结预训练主干暴露的几何结构,当主干规模扩大时,检测器选择的重要性下降,可直接在冻结模型上高效部署。

原文摘要 · Abstract (English)

Models trained with deep learning often fail to signal when inputs fall outside their training data manifold, leading to unreliable predictions under distribution shift. Prior work suggests that effective out-of-distribution (OOD) detection often requires class-conditional modeling or specialized models obtained through supervised fine-tuning. We revisit this assumption in modern pretrained models and show that their frozen representations already encode sufficient geometric structure for accurate label-free OOD detection. Across 59 backbone-task pairings spanning vision and language, we compare two complementary label-free detectors: a global Mahalanobis estimator fit on unlabeled latent representations, and ReSCOPED, a lightweight, diffusion-based typicality estimator operating on the same features at a local level. Despite their different detection mechanisms, representation scaling reveals a consistent regime-dependent pattern: both local and global detectors' absolute performance improves with better representation quality, and performance gaps between the two detectors disappear across both language and vision tasks as representations scale. These results suggest that label-free OOD detection depends strongly on the geometry exposed by frozen pretrained backbones, reducing the importance of detector choice as backbone scale increases and enabling efficient deployment directly on frozen models.

OOD检测预训练模型无监督扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。