arXiv:2606.29952cs.LGcs.AI2026-06

提出轻量级方法Fold,用局部平坦性区分分布外数据,效果更好且不需重训练。

Exploiting Local Flatness for Efficient Out-of-Distribution Detection

论文配图:Exploiting Local Flatness for Efficient Out-of-Distribution Detection
图 1 · 摘自论文原文
  • 基于特征海森矩阵和部分归一化,捕捉输入数据的局部平坦性差异。
  • 在多个基准上平均提升AUROC 1.63%,FPR95降低2.30%。
  • 自监督调参无需外部数据,适合实际部署场景。

检测分布外(OOD)数据对可靠机器学习部署至关重要。后处理方法因其无需重新训练而极具吸引力,但现有基于损失曲率的方法计算成本高,且依赖关于曲率差异的隐含假设。本文首次系统研究该差异,发现分布外输入的海森曲率显著大于分布内数据,且在更强分布偏移下差距扩大。受此启发,提出Fold:一种轻量级平坦性调制型OOD检测器,利用特征海森矩阵与部分特征归一化,提升分布内/外可分性,避免昂贵的参数空间曲率近似。为适应不同数据集,进一步引入AutoFold——通过分布内logit掩码生成伪分布外样本,实现无外部数据的自监督调参。实验表明,Fold在主流基准上平均提升AUROC 1.63%,降低FPR95 2.30%,同时保持与标准前向传播相当的计算效率。理论分析与大量消融验证了其原理性与实用性。

原文摘要 · Abstract (English)

Detecting out-of-distribution (OOD) data is crucial for reliable machine learning deployment. Among detection strategies, post-hoc methods are particularly attractive due to their efficiency, as they operate directly on pre-trained networks without requiring retraining. Within this paradigm, one promising direction exploits loss-landscape curvature to estimate model uncertainty; however, such methods incur substantial computational cost and rely on implicit assumptions about how landscape flatness differs between in-distribution (ID) and OOD data. In this work, we provide the first systematic investigation of this curvature discrepancy and show that OOD inputs exhibit larger Hessian curvature than ID data, with the gap widening under stronger distributional shifts. Motivated by these observations, we propose Fold, a lightweight flatness-modulated OOD detector that leverages the feature Hessian and partial feature normalization to improve ID-OOD separability while avoiding costly parameter-space curvature approximations. To optimally adapt this normalization across diverse datasets, we further introduce AutoFold, a self-supervised tuning scheme that synthesizes pseudo-OOD samples via ID logit masking for automatic calibration without requiring external data. Experiments on OOD benchmarks show that Fold outperforms prior methods, improving the average AUROC by 1.63% and reducing FPR95 by 2.30%, while maintaining computational efficiency comparable to a standard forward pass. Supported by theoretical analysis and extensive ablations, Fold provides a principled and practical solution for robust real-world deployment.

OOD检测曲率分析轻量模型自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。