arXiv:2504.07240cs.LG2025-04CVPR被引 13

无标签原型存储+聚类保持损失,实现持续学习中旧知识保留与新任务适应。

Prototype-Based Continual Learning with Label-free Replay Buffer and Cluster Preservation Loss

  • 用无标签原型自动选择记忆样本,保持潜在空间聚类结构。
  • 在多个数据集上超越当前最优方法,部分场景甚至优于离线学习。
  • 适用于无监督增量学习,适合缺乏标注数据的持续学习场景。

持续学习通常依赖带标签数据进行回放样本选择。本文提出一种无需标签的原型存储机制,通过自动选取无标签原型并引入聚类保持损失,确保跨任务间潜在空间聚类结构的稳定性。针对类别增量和领域增量场景,设计了“推远”与“拉近”机制,以兼顾旧知识保留与新任务适应。在SplitCIFAR100、SplitImageNet32、SplitTinyImageNet、SplitCaltech256(类别增量)以及R-MNIST、CORe50(领域增量)等基准上使用预提取的DINOv2特征进行评估。实验表明,该方法显著优于现有持续学习技术,在某些情况下甚至超过离线学习性能。此外,类别增量设置下的无监督变体也表现良好,部分场景超越特定监督基线。结果验证了该框架在知识保留与持续适应方面的有效性。

原文摘要 · Abstract (English)

Continual learning techniques employ simple replay sample selection processes and use them during subsequent tasks. Typically, they rely on labeled data. In this paper, we depart from this by automatically selecting prototypes stored without labels, preserving cluster structures in the latent space across tasks. By eliminating label dependence in the replay buffer and introducing cluster preservation loss, it is demonstrated that the proposed method can maintain essential information from previously encountered tasks while ensuring adaptation to new tasks. "Push-away" and "pull-toward" mechanisms over previously learned prototypes are also introduced for class-incremental and domain-incremental scenarios. These mechanisms ensure the retention of previously learned information as well as adaptation to new classes or domain shifts. The proposed method is evaluated on several benchmarks, including SplitCIFAR100, SplitImageNet32, SplitTinyImageNet, and SplitCaltech256 for class-incremental, as well as R-MNIST and CORe50 for domain-incremental setting using pre-extracted DINOv2 features. Experimental results indicate that the label-free replay-based technique outperforms state-of-the-art continual learning methods and, in some cases, even surpasses offline learning. An unsupervised variant of the proposed technique for the class-incremental setting, avoiding labels use even on incoming data, also demonstrated competitive performance, outperforming particular supervised baselines in some cases. These findings underscore the effectiveness of the proposed framework in retaining prior information and facilitating continual adaptation.

持续学习无监督聚类保持原型存储

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。