arXiv:2412.14430cs.LG2024-12

通过平衡冲突与对齐样本,提升持续学习中的知识保留能力。

Balanced Gradient Sample Retrieval for Enhanced Knowledge Retention in Proxy-based Continual Learning

  • 从记忆缓冲区中同时选取梯度冲突和梯度对齐样本。
  • 在主流视觉基准上显著降低遗忘率,保持新任务竞争力。
  • 适合需要长期稳定学习的持续学习场景,如智能系统迭代。

深度神经网络的持续学习常面临灾难性遗忘问题,即后续训练会覆盖先前任务的表征。本文提出一种基于代理的持续学习框架下的新型样本检索策略,利用梯度冲突与梯度对齐样本共同增强过往任务知识的保留。梯度冲突样本用于缓解干扰,通过重新对齐梯度来保护旧知识;梯度对齐样本则强化跨任务间稳定的共享表征。通过平衡冲突样本带来的梯度修正与对齐样本带来的表征强化,该方法提升了检索实例的多样性,并在参数空间中实现更优对齐,显著增强知识保留并缓解代理漂移。实验表明,同时使用两类样本的方法优于仅依赖单一类型或随机检索的方案。在计算机视觉领域的主流持续学习基准上,本方法在减少遗忘的同时保持了优异的新任务准确率,达到当前最优性能。

原文摘要 · Abstract (English)

Continual learning in deep neural networks often suffers from catastrophic forgetting, where representations for previous tasks are overwritten during subsequent training. We propose a novel sample retrieval strategy from the memory buffer that leverages both gradient-conflicting and gradient-aligned samples to effectively retain knowledge about past tasks within a supervised contrastive learning framework. Gradient-conflicting samples are selected for their potential to reduce interference by re-aligning gradients, thereby preserving past task knowledge. Meanwhile, gradient-aligned samples are incorporated to reinforce stable, shared representations across tasks. By balancing gradient correction from conflicting samples with alignment reinforcement from aligned ones, our approach increases the diversity among retrieved instances and achieves superior alignment in parameter space, significantly enhancing knowledge retention and mitigating proxy drift. Empirical results demonstrate that using both sample types outperforms methods relying solely on one sample type or random retrieval. Experiments on popular continual learning benchmarks in computer vision validate our method's state-of-the-art performance in mitigating forgetting while maintaining competitive accuracy on new tasks.

持续学习知识保留梯度对齐代理学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。