arXiv:2509.05778cs.LGcs.AI2025-09

提出双交叉验证框架,更可靠评估分布外检测模型性能。

DCV-ROOD Evaluation Framework: Dual Cross-Validation for Robust Out-of-Distribution Detection

  • 用两类数据分组方式分别划分正常与分布外数据
  • 在多个数据集上快速收敛到真实性能表现
  • 适合评估抗分布偏移的AI模型,尤其关注可靠性

分布外(OOD)检测在提升人工智能系统鲁棒性方面至关重要,能识别显著偏离训练分布的输入,避免不可靠预测并触发备用机制。开发可靠的OOD检测方法面临挑战,严谨的评估对确保其有效性不可或缺。交叉验证(CV)已被证明是有效估计学习算法性能的工具。尽管OOD场景具有特殊性,但适当调整CV可构建合适的评估框架。本文提出一种用于稳健评估OOD检测模型的双交叉验证框架(DCV-ROOD),旨在整合正常分布(ID)与分布外(OOD)数据,并考虑二者差异。具体而言,采用常规方式划分ID数据,而将OOD数据按类别分组划分;同时分析具有类别层次结构的数据,提出基于完整类别层级的划分策略,以实现公平的ID-OOD分割。该框架通过测试一系列先进OOD检测方法(含/不含异常暴露)验证其有效性,结果显示其能快速收敛至真实性能。

原文摘要 · Abstract (English)

Out-of-distribution (OOD) detection plays a key role in enhancing the robustness of artificial intelligence systems by identifying inputs that differ significantly from the training distribution, thereby preventing unreliable predictions and enabling appropriate fallback mechanisms. Developing reliable OOD detection methods is a significant challenge, and rigorous evaluation of these techniques is essential for ensuring their effectiveness, as it allows researchers to assess their performance under diverse conditions and to identify potential limitations or failure modes. Cross-validation (CV) has proven to be a highly effective tool for providing a reasonable estimate of the performance of a learning algorithm. Although OOD scenarios exhibit particular characteristics, an appropriate adaptation of CV can lead to a suitable evaluation framework for this setting. This work proposes a dual CV framework for robust evaluation of OOD detection models, aimed at improving the reliability of their assessment. The proposed evaluation framework aims to effectively integrate in-distribution (ID) and OOD data while accounting for their differing characteristics. To achieve this, ID data are partitioned using a conventional approach, whereas OOD data are divided by grouping samples based on their classes. Furthermore, we analyze the context of data with class hierarchy to propose a data splitting that considers the entire class hierarchy to obtain fair ID-OOD partitions to apply the proposed evaluation framework. This framework is called Dual Cross-Validation for Robust Out-of-Distribution Detection (DCV-ROOD). To test the validity of the evaluation framework, we selected a set of state-of-the-art OOD detection methods, both with and without outlier exposure. The results show that the method achieves very fast convergence to the true performance.

OOD检测交叉验证模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。