提出高效选择重要样本的方法,提升持续学习的存储与计算效率。
PDAC: Efficient Coreset Selection for Continual Learning via Probability Density Awareness
- 基于概率密度感知,优先选取高密度区域样本
- 理论证明高密度样本对误差抑制起主导作用
- 适用于资源受限的持续学习场景
基于回放的持续学习(CL)通过有限记忆缓冲区存储重放样本以维持知识,其性能高度依赖于所存样本的质量。现有方法通常构建核心集(coreset)以近似全数据集训练效果,但主流核心集选择(CS)方法将问题建模为双层优化,需大量内外层迭代,计算开销大。本文从局部误差分解角度分析缓冲区训练模型与贝叶斯最优模型间的均方误差(MSE),发现高概率密度样本在抑制误差中起主导作用。据此提出概率密度感知核心集(PDAC)方法,利用投影高斯混合(PGM)模型估计样本联合密度,实现密度优先的高效缓冲区选择。进一步引入流式期望最大化(EM)算法,提升PGM参数对流式数据的适应性,形成流式版本SPDAC。大量对比实验表明,本方法在多种持续学习设置下均优于基线,且保持良好效率。
原文摘要 · Abstract (English)
Rehearsal-based Continual Learning (CL) maintains a limited memory buffer to store replay samples for knowledge retention, making these approaches heavily reliant on the quality of the stored samples. Current Rehearsal-based CL methods typically construct the memory buffer by selecting a representative subset (referred to as coresets), aiming to approximate the training efficacy of the full dataset with minimal storage overhead. However, mainstream Coreset Selection (CS) methods generally formulate the CS problem as a bi-level optimization problem that relies on numerous inner and outer iterations to solve, leading to substantial computational cost thus limiting their practical efficiency. In this paper, we aim to provide a more efficient selection logic and scheme for coreset construction. To this end, we first analyze the Mean Squared Error (MSE) between the buffer-trained model and the Bayes-optimal model through the perspective of localized error decomposition to investigate the contribution of samples from different regions to MSE suppression. Further theoretical and experimental analyses demonstrate that samples with high probability density play a dominant role in error suppression. Inspired by this, we propose the Probability Density-Aware Coreset (PDAC) method. PDAC leverages the Projected Gaussian Mixture (PGM) model to estimate each sample's joint density, enabling efficient density-prioritized buffer selection. Finally, we introduce the streaming Expectation Maximization (EM) algorithm to enhance the adaptability of PGM parameters to streaming data, yielding Streaming PDAC (SPDAC) for streaming scenarios. Extensive comparative experiments show that our methods outperforms other baselines across various CL settings while ensuring favorable efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。