arXiv:2409.11884cs.LG2024-09中稿 · ACM Computing Surv…综述被引 47

从任务视角梳理新式分布外检测方法,助力构建更可靠的AI系统。

Out-of-Distribution Detection: A Task-Oriented Survey of Recent Advances

  • 按是否可修改模型分训练驱动与无须训练两类,新增大模型基底检测类别
  • 涵盖测试时自适应、多模态等新型场景下的检测方案
  • 适合关注实际应用与前沿方向的研究者参考

分布外(OOD)检测旨在识别超出训练类别空间的测试样本,是构建可靠机器学习系统的关键。现有综述多聚焦方法分类,但近年研究日益关注测试时自适应、多模态数据源等非传统场景。本文首次从任务导向视角综述近期进展:根据用户能否修改或重训模型,将方法分为训练驱动型与训练无关型;同时针对预训练模型的快速发展,专门讨论基于大模型的OOD检测。此外,还分析评估场景、多种应用场景及未来研究方向。我们相信这一新分类体系将推动新方法提出与更多实用场景拓展。相关论文列表已整理至GitHub仓库:https://github.com/shuolucs/Awesome-Out-Of-Distribution-Detection。

原文摘要 · Abstract (English)

Out-of-distribution (OOD) detection aims to detect test samples outside the training category space, which is an essential component in building reliable machine learning systems. Existing reviews on OOD detection primarily focus on method taxonomy, surveying the field by categorizing various approaches. However, many recent works concentrate on non-traditional OOD detection scenarios, such as test-time adaptation, multi-modal data sources and other novel contexts. In this survey, we uniquely review recent advances in OOD detection from the task-oriented perspective for the first time. According to the user's access to the model, that is, whether the OOD detection method is allowed to modify or retrain the model, we classify the methods as training-driven or training-agnostic. Besides, considering the rapid development of pre-trained models, large pre-trained model-based OOD detection is also regarded as an important category and discussed separately. Furthermore, we provide a discussion of the evaluation scenarios, a variety of applications, and several future research directions. We believe this survey with new taxonomy will benefit the proposal of new methods and the expansion of more practical scenarios. A curated list of related papers is provided in the Github repository: https://github.com/shuolucs/Awesome-Out-Of-Distribution-Detection.

OOD检测任务导向大模型综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。