arXiv:2507.12043cs.LG2025-07被引 2

为基于回放的持续学习提供理论保障,揭示记忆缓冲区对泛化能力的影响。

Information-Theoretic Generalization Bounds of Replay-based Continual Learning

  • 从信息论出发,建立统一理论框架,分析记忆缓冲区与当前任务的关系。
  • 提出可计算的紧致上界,证明选择样本数量与信息依赖性存在权衡。
  • 适用于多种算法,如SGLD,适合关注理论解释的持续学习研究者。

持续学习(CL)已成为从序列任务中获取知识并避免灾难性遗忘的主要范式。尽管已有众多方法在实验中表现优异,但其泛化行为的理论理解仍不充分,尤其针对基于回放的方法。本文建立了统一的信息论理论框架,推导出一系列显式刻画记忆缓冲区与当前任务对泛化性能影响的边界。具体而言,基于假设的边界捕捉了所选样本数量与假设和记忆缓冲区间信息依赖性的权衡;基于预测的边界利用低维变量,得到更紧且可计算的泛化误差上界。理论分析具有普遍性,广泛适用于多种学习算法,以随机梯度朗之万动力学(SGLD)为例进行验证。大量实验表明,所推导的边界能有效捕捉基于回放的持续学习中的泛化动态。

原文摘要 · Abstract (English)

Continual learning (CL) has emerged as a dominant paradigm for acquiring knowledge from sequential tasks while avoiding catastrophic forgetting. Although many CL methods have been proposed to show impressive empirical performance, the theoretical understanding of their generalization behavior remains limited, particularly for replay-based approaches. This paper establishes a unified theoretical framework for replay-based CL, deriving a series of information-theoretic generalization bounds that explicitly elucidate the impact of the memory buffer alongside the current task on generalization performance. Specifically, our hypothesis-based bounds capture the trade-off between the number of selected exemplars and the information dependency between the hypothesis and the memory buffer. Our prediction-based bounds yield tighter and computationally tractable upper bounds on the generalization error by leveraging low-dimensional variables. Theoretical analysis is general and broadly applicable to a wide range of learning algorithms, exemplified by stochastic gradient Langevin dynamics (SGLD) as a representative method. Comprehensive experimental evaluations demonstrate the effectiveness of our derived bounds in capturing the generalization dynamics in replay-based CL settings.

持续学习信息论泛化边界理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。