arXiv:2502.17794cs.LG2025-02

提出PVBF框架,缓解在线持续学习中参数更新偏差问题。

PVBF: A Framework for Mitigating Parameter Variation Imbalance in Online Continual Learning

  • 基于参数变化计算任务间相关性,动态调整梯度方向。
  • 在短/长任务序列上提升准确率,最高比现有方法高47%。
  • 适合需要稳定持续学习的场景,如智能推荐、自动驾驶。

在线持续学习(OCL)使AI系统能从非平稳数据流中自适应学习,通常采用基于经验回放(ER)的方法,通过训练时重放存储的历史数据来保留知识。然而,这类方法在任务切换时常出现预测偏差,源于参数更新方向的偏离。本文识别出参数变化不平衡是导致该偏差的关键因素。具体而言,提出的参数变化评估方法揭示了两种不平衡:相关性引发的不平衡,即某些参数在不同任务间被过度更新;层间不平衡,即输出层参数更新速度远快于前序层。为此,我们提出参数变化平衡框架(PVBF),包含三部分:1)基于参数变化计算与以往任务的相关性新方法;2)利用相关性进行全局梯度调整的鼓励-巩固(E&C)机制;3)双层权重复制并重初始化(D-CWR)策略,缓慢更新频繁出现类别对应的输出层参数。在短和长任务序列上的实验表明,PVBF显著降低预测偏差,提升OCL性能,相比现有基于ER的方法,准确率最高提升47%。

原文摘要 · Abstract (English)

Online continual learning (OCL), which enables AI systems to adaptively learn from non-stationary data streams, is commonly achieved using experience replay (ER)-based methods that retain knowledge by replaying stored past during training. However, these methods face challenges of prediction bias, stemming from deviations in parameter update directions during task transitions. This paper identifies parameter variation imbalance as a critical factor contributing to prediction bias in ER-based OCL. Specifically, using the proposed parameter variation evaluation method, we highlight two types of imbalance: correlation-induced imbalance, where certain parameters are disproportionately updated across tasks, and layer-wise imbalance, where output layer parameters update faster than those in preceding layers. To mitigate the above imbalances, we propose the Parameter Variation Balancing Framework (PVBF), which incorporates: 1) a novel method to compute parameter correlations with previous tasks based on parameter variations, 2) an encourage-and-consolidate (E&C) method utilizing parameter correlations to perform gradient adjustments across all parameters during training, 3) a dual-layer copy weights with reinit (D-CWR) strategy to slowly update output layer parameters for frequently occuring sample categories. Experiments on short and long task sequences demonstrate that PVBF significantly reduces prediction bias and improves OCL performance, achieving up to 47\% higher accuracy compared to existing ER-based methods.

持续学习参数均衡经验回放在线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。