arXiv:2411.00430cs.LGcs.CV2024-11中稿 · Neurocomputing Jou…被引 1

通过分布外检测实现无任务标识的持续学习,缓解遗忘问题。

Class Incremental Learning with Task-Specific Batch Normalization and Out-of-Distribution Detection

  • 用任务专属批归一化与分类头提升新旧知识平衡
  • 在多个医学与自然图像数据集上达到顶尖性能
  • 适合无法获取任务标签的现实场景应用

本研究针对图像分类中的持续学习问题,探索在无法访问旧数据时如何减少灾难性遗忘。挑战在于平衡学习新知识的灵活性与保留旧知识的稳定性。根据测试阶段是否提供任务标识(task-ID),持续学习分为任务增量学习(TIL)和类别增量学习(CIL)。TIL通常使用多个分类头,根据task-ID选择对应头;而CIL无法获取task-ID,因此需先预测任务标识才能适配TIL方法。本文提出一种新框架,通过引入分布外检测进行task-ID预测,将TIL方法拓展至CIL。该框架采用任务专属批归一化(BN)和分类头,分别调整各任务特征分布以增强灵活性;任务专属BN参数远少于卷积核,有效控制参数增长以维持稳定性。每类分类头额外引入“未知”类别:训练时其他任务数据映射至此类别;推理时通过选择“未知”类概率最低的分类头来推断task-ID。实验表明,该方法在两个医学图像数据集和两个自然图像数据集上均取得当前最优表现。代码已开源。

原文摘要 · Abstract (English)

This study focuses on incremental learning for image classification, exploring how to reduce catastrophic forgetting of all learned knowledge when access to old data is restricted. The challenge lies in balancing plasticity (learning new knowledge) and stability (retaining old knowledge). Based on whether the task identifier (task-ID) is available during testing, incremental learning is divided into task incremental learning (TIL) and class incremental learning (CIL). The TIL paradigm often uses multiple classifier heads, selecting the corresponding head based on the task-ID. Since the CIL paradigm cannot access task-ID, methods originally developed for TIL require explicit task-ID prediction to bridge this gap and enable their adaptation to the CIL paradigm. {In this study, a novel continual learning framework extends the TIL method for CIL by introducing out-of-distribution detection for task-ID prediction. Our framework utilizes task-specific Batch Normalization (BN) and task-specific classification heads to effectively adjust feature map distributions for each task, enhancing plasticity. With far fewer parameters than convolutional kernels, task-specific BN helps minimize parameter growth, preserving stability. Based on multiple task-specific classification heads, we introduce an ``unknow'' class for each head. During training, data from other tasks are mapped to this unknown class. During inference, the task-ID is predicted by selecting the classification head with the lowest probability assigned to the unknown class. Our method achieves state-of-the-art performance on two medical image datasets and two natural image datasets. The source code is available at https://github.com/z1968357787/mbn_ood_git_main.

持续学习批归一化分布外检测医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。