arXiv:2503.10439cs.CV2025-03被引 2

解决冷启动下无样本增量学习的特征漂移问题,提升模型持续学习能力。

EFC++: Elastic Feature Consolidation with Prototype Re-balancing for Cold Start Exemplar-free Incremental Learning

  • 通过经验特征矩阵构建伪度量,正则化关键方向上的特征漂移。
  • 引入高斯原型更新与后训练重平衡,缓解任务新近性偏差。
  • 在多个数据集上超越现有方法,尤其适合初始数据稀缺场景。

无样本类别增量学习(EFCIL)旨在不访问历史数据的情况下,从任务序列中学习。本文关注冷启动场景——首阶段数据不足,难以训练高质量主干网络。这在无样本设置下尤为挑战,因需高可塑性,易导致特征漂移且难以补偿。为此,提出弹性特征整合++(EFC++),通过基于经验特征矩阵(EFM)的二阶近似,建模特征漂移,并在重要方向上施加正则化;同时利用高斯原型减少任务新近性偏差。此外,设计后训练原型重平衡阶段,以修正分类器补偿特征漂移。在CIFAR-100、Tiny-ImageNet、ImageNet-Subset、ImageNet-1K和DomainNet上的实验表明,EFC++在保持模型可塑性的前提下显著优于当前最优方法。

原文摘要 · Abstract (English)

Exemplar-free Class Incremental Learning (EFCIL) aims to learn from a sequence of tasks without having access to previous task data. In this paper, we consider the challenging Cold Start scenario in which insufficient data is available in the first task to learn a high-quality backbone. This is especially challenging for EFCIL since it requires high plasticity, resulting in feature drift which is difficult to compensate for in the exemplar-free setting. To address this problem, we propose an effective approach to consolidate feature representations by regularizing drift in directions highly relevant to previous tasks while employing prototypes to reduce task-recency bias. Our approach, which we call Elastic Feature Consolidation++ (EFC++) exploits a tractable second-order approximation of feature drift based on a proposed Empirical Feature Matrix (EFM). The EFM induces a pseudo-metric in feature space which we use to regularize feature drift in important directions and to update Gaussian prototypes. In addition, we introduce a post-training prototype re-balancing phase that updates classifiers to compensate for feature drift. Experimental results on CIFAR-100, Tiny-ImageNet, ImageNet-Subset, ImageNet-1K and DomainNet demonstrate that EFC++ is better able to learn new tasks by maintaining model plasticity and significantly outperforms the state-of-the-art.

增量学习特征漂移冷启动无样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。