arXiv:2505.04787cs.CVcs.AI2025-05被引 2

用生成回放增强记忆,无监督持续学习效果刷新纪录

Replay to Remember (R2R): An Efficient Uncertainty-driven Unsupervised Continual Learning Framework Using Generative Replay

  • 基于不确定性反馈动态生成合成数据,平衡真实与虚拟样本
  • 在多个数据集上实现最高98.13%准确率,超越现有方法超4.36%
  • 无需预训练,适合资源受限的在线学习场景

持续学习需在获取新知识的同时保留旧知识,避免神经网络的灾难性遗忘。本文提出一种基于生成回放的不确定驱动无监督持续学习框架R2R。该框架通过聚类级不确定性反馈机制和视觉语言模型(CLIP VLM)驱动的生成模块,以均衡比例利用未标记数据与合成标记数据。不同于依赖预训练模型和伪标签的传统内存缓冲方法,R2R无需任何前期训练,仅依靠未标记数据的视觉特征,结合基于聚类的不确定性估计与动态阈值实现持续自适应。同时,由DeepSeek-R1驱动的生成回放机制可生成代表过往经验的合成标签数据,模拟生物视觉思维中“回放记忆以应对新任务”的过程。在CIFAR-10、CIFAR-100、CINIC-10、SVHN和TinyImageNet上进行广泛实验,R2R分别取得98.13%、73.06%、93.41%、95.18%、59.74%的准确率,性能超越现有最优结果超4.36%。

原文摘要 · Abstract (English)

Continual Learning entails progressively acquiring knowledge from new data while retaining previously acquired knowledge, thereby mitigating ``Catastrophic Forgetting'' in neural networks. Our work presents a novel uncertainty-driven Unsupervised Continual Learning framework using Generative Replay, namely ``Replay to Remember (R2R)''. The proposed R2R architecture efficiently uses unlabelled and synthetic labelled data in a balanced proportion using a cluster-level uncertainty-driven feedback mechanism and a VLM-powered generative replay module. Unlike traditional memory-buffer methods that depend on pretrained models and pseudo-labels, our R2R framework operates without any prior training. It leverages visual features from unlabeled data and adapts continuously using clustering-based uncertainty estimation coupled with dynamic thresholding. Concurrently, a generative replay mechanism along with DeepSeek-R1 powered CLIP VLM produces labelled synthetic data representative of past experiences, resembling biological visual thinking that replays memory to remember and act in new, unseen tasks. Extensive experimental analyses are carried out in CIFAR-10, CIFAR-100, CINIC-10, SVHN and TinyImageNet datasets. Our proposed R2R approach improves knowledge retention, achieving a state-of-the-art performance of 98.13%, 73.06%, 93.41%, 95.18%, 59.74%, respectively, surpassing state-of-the-art performance by over 4.36%.

持续学习生成回放无监督视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。