用拉普拉斯核建模特征相关性,提升无数据持续学习的生成质量。
Stop Marginalizing My Dreams: Model Inversion via Laplace Kernel for Continual Learning

- 引入拉普拉斯核参数化,实现可扩展的全协方差建模。
- 合成样本更连贯,在主流基准上性能显著提升。
- 适合关注无数据持续学习与模型逆向生成的研究者。
无数据持续学习(DFCIL)依赖模型逆向生成伪样本以缓解灾难性遗忘。现有方法因假设特征分布为对角协方差,忽略特征间相关性,导致生成样本保真度低,限制知识保留。本文提出REMIX框架,通过拉普拉斯核参数化实现结构化协方差建模,内存开销随特征维度线性增长,计算复杂度仅增加对数因子,避免了密集矩阵求逆和对数行列式计算的高昂成本。该方法有效捕捉特征依赖关系,生成更连贯的伪样本,在标准DFCIL基准上实现一致性能提升。结果表明,突破对角协方差假设是实现高效可扩展无数据持续学习的关键。代码已开源。
原文摘要 · Abstract (English)
Data-free continual learning (DFCIL) relies on model inversion to synthesize pseudo-samples and mitigate catastrophic forgetting. However, existing inversion methods are fundamentally limited by a simplifying assumption: they model feature distributions using diagonal covariance, effectively ignoring correlations that define the geometry of learned representations. As a result, synthesized samples often lack fidelity, limiting knowledge retention. In this work, we show that modeling feature dependencies is a key ingredient for effective DFCIL. We introduce REMIX, a structured covariance modeling framework that enables scalable full-covariance modeling without the prohibitive cost of dense matrix inversion and log-determinant computation. By leveraging a Laplace kernel parameterization, REMIX captures structured feature dependencies using memory that scales linearly with the feature dimensionality, while requiring only an additional logarithmic factor in computation. Modeling these correlations produces more coherent synthetic samples and consistently improves performance across standard DFCIL benchmarks. Our results demonstrate that moving beyond diagonal assumptions is essential for effective and scalable data-free continual learning. Our code is available at https://github. com/pkrukowski1/REMIX-Model-Inversion-via-Laplace-Kernel.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。