arXiv:2503.14832cs.CVcs.LG2025-03CVPR被引 6

提出分层双样本检验法,实现持续学习中无阈值的任务级分布外检测。

H2ST: Hierarchical Two-Sample Tests for Continual Out-of-Distribution Detection

  • 基于假设检验设计分层双样本测试,无需人工调阈值。
  • 在多个数据集上实现95%以上的任务级分布外识别准确率。
  • 适合开放世界持续学习场景,尤其适用于模型性能波动大的应用。

任务增量学习(TIL)是持续学习(CL)的一种特殊形式,模型需从非平稳数据流中逐步学习。现有TIL方法多基于封闭世界假设,认为输入数据始终为分布内(ID)。然而在开放世界中,新样本可能来自未知的分布外(OOD)源,且任务身份未知。当前分布外检测方法面临三大挑战:依赖模型输出导致对模型性能过度敏感、阈值选择困难、二元分类无法提供任务级别识别。为此,本文提出一种新型持续分布外检测方法——分层双样本检验(H2ST)。H2ST通过假设检验消除阈值选择需求,利用特征图更充分挖掘模型能力,降低对模型性能的依赖。其分层架构支持任务级检测,在性能与开销上优于非分层的分类器双样本测试。大量实验验证了H2ST在开放世界TIL场景下的有效性,显著优于现有方法。代码已开源于https://github.com/YuhangLiuu/H2ST。

原文摘要 · Abstract (English)

Task Incremental Learning (TIL) is a specialized form of Continual Learning (CL) in which a model incrementally learns from non-stationary data streams. Existing TIL methodologies operate under the closed-world assumption, presuming that incoming data remains in-distribution (ID). However, in an open-world setting, incoming samples may originate from out-of-distribution (OOD) sources, with their task identities inherently unknown. Continually detecting OOD samples presents several challenges for current OOD detection methods: reliance on model outputs leads to excessive dependence on model performance, selecting suitable thresholds is difficult, hindering real-world deployment, and binary ID/OOD classification fails to provide task-level identification. To address these issues, we propose a novel continual OOD detection method called the Hierarchical Two-sample Tests (H2ST). H2ST eliminates the need for threshold selection through hypothesis testing and utilizes feature maps to better exploit model capabilities without excessive dependence on model performance. The proposed hierarchical architecture enables task-level detection with superior performance and lower overhead compared to non-hierarchical classifier two-sample tests. Extensive experiments and analysis validate the effectiveness of H2ST in open-world TIL scenarios and its superiority to the existing methods. Code is available at \href{https://github.com/YuhangLiuu/H2ST}{https://github.com/YuhangLiuu/H2ST}.

持续学习分布外检测假设检验开放世界

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。