arXiv:2409.14983cs.CVcs.AI2024-09CVPR被引 12

提出DIA框架,解决无示例增量学习中遗忘问题。

Dynamic Integration of Task-Specific Adapters for Class Incremental Learning

  • 用分块适配器动态整合新任务特征,灵活且低计算开销。
  • 在CIFAR-100和ImageNet-100上准确率提升显著,优于现有方法。
  • 适合需要持续学习且不存储旧数据的场景,如隐私敏感应用。

非示例类增量学习(NECIL)使模型能持续学习新类别,无需从头训练或存储旧任务样本,缓解了隐私与存储问题。然而,缺乏早期任务数据加剧了灾难性遗忘。本文提出动态任务适配器集成框架(DIA),包含两个核心组件:任务特定适配器集成(TSAI)与分块级模型对齐。TSAI通过分块级适配器融合策略提升特征组合能力,灵活性高且计算成本低。分块级模型对齐通过分块级知识蒸馏损失(PDL)和分块级特征重建(PFR)维持特征一致性与分类边界准确。PDL基于块标记对新类学习的贡献实现特征级一致性保持;PFR则通过重构旧类别特征实现分类器精准对齐。大量实验验证了DIA的有效性,在基准数据集上显著提升NECIL性能,同时平衡了计算复杂度与准确率。

原文摘要 · Abstract (English)

Non-exemplar class Incremental Learning (NECIL) enables models to continuously acquire new classes without retraining from scratch and storing old task exemplars, addressing privacy and storage issues. However, the absence of data from earlier tasks exacerbates the challenge of catastrophic forgetting in NECIL. In this paper, we propose a novel framework called Dynamic Integration of task-specific Adapters (DIA), which comprises two key components: Task-Specific Adapter Integration (TSAI) and Patch-Level Model Alignment. TSAI boosts compositionality through a patch-level adapter integration strategy, which provides a more flexible compositional solution while maintaining low computation costs. Patch-Level Model Alignment maintains feature consistency and accurate decision boundaries via two specialized mechanisms: Patch-Level Distillation Loss (PDL) and Patch-Level Feature Reconstruction method (PFR). Specifically, the PDL preserves feature-level consistency between successive models by implementing a distillation loss based on the contributions of patch tokens to new class learning. The PFR facilitates accurate classifier alignment by reconstructing old class features from previous tasks that adapt to new task knowledge. Extensive experiments validate the effectiveness of our DIA, revealing significant improvements on benchmark datasets in the NECIL setting, maintaining an optimal balance between computational complexity and accuracy.

增量学习适配器灾难性遗忘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。