arXiv:2502.18762cs.LGcs.AI2025-02

提出细粒度超梯度机制,实现无记忆在线持续学习

From Offline to Online Memory-Free and Task-Free Continual Learning via Fine-Grained Hypergradients

  • 用轻量原型增强离线方法,提升在线适应性
  • 引入细粒度超梯度重平衡梯度,缓解早任务偏差
  • 无需记忆、无需任务边界,适合真实流数据场景

持续学习(CL)旨在从非平稳数据流中学习,其分布随时间变化。尽管近期高效无记忆的离线持续学习(offCL)方法取得进展,但在线持续学习(onCL)仍以需存储记忆的方法为主。从offCL到onCL的迁移困难,因多数离线方法依赖(1)任务边界先验知识,(2)复杂调度或优化策略,而这些在数据顺序到达且仅可访问一次时无法获取。本文研究将先进无记忆offCL方法迁移到在线设置。首先发现,通过添加轻量原型可显著提升性能,但引发梯度不平衡,导致对早期任务过度学习。为此,提出细粒度超梯度机制,在训练中动态重平衡梯度更新。实验表明,原型与超梯度重加权的协同作用显著提升无记忆方法在onCL中的表现,优于现有onCL基线。代码将在录用后发布。

原文摘要 · Abstract (English)

Continual Learning (CL) aims to learn from a non-stationary data stream where the underlying distribution changes over time. While recent advances have produced efficient memory-free methods in the offline CL (offCL) setting, where tasks are known in advance and data can be revisited, online CL (onCL) remains dominated by memory-based approaches. The transition from offCL to onCL is challenging, as many offline methods rely on (1) prior knowledge of task boundaries and (2) sophisticated scheduling or optimization schemes, both of which are unavailable when data arrives sequentially and can be seen only once. In this paper, we investigate the adaptation of state-of-the-art memory-free offCL methods to the online setting. We first show that augmenting these methods with lightweight prototypes significantly improves performance, albeit at the cost of increased Gradient Imbalance, resulting in a biased learning towards earlier tasks. To address this issue, we introduce Fine-Grained Hypergradients, an online mechanism for rebalancing gradient updates during training. Our experiments demonstrate that the synergy between prototype memory and hypergradient reweighting substantially enhances the performance of memory-free methods in onCL and surpasses onCL baselines. Code will be released upon acceptance.

持续学习无记忆在线学习超梯度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。