无需存储数据,用统计生成样本来实现无监督持续学习。
Unsupervised Continual Learning with Growing Self-Organizing Maps and Synthetic Replay

- 用动态自组织映射记录数据分布统计量,生成合成样本用于重放。
- 在多个基准上表现接近有监督顶尖方法,单类增量场景优势明显。
- 适合无标签、无任务边界场景,可扩展性强,适用于资源受限环境。
本文提出一种基于生长自组织映射(GSOM)的生成式持续学习框架,通过学习数据分布统计量并结合编码器-解码器结构实现类增量学习。该方法无需存储原始数据,仅利用各GSOM单元维护的均值、方差和协方差估计,生成合成样本进行重放;在编码器-解码器配置中,通过祖先采样将样本解码回输入空间以供后续训练。整个过程完全无监督,不依赖显式任务边界或类别标签。在多个基准测试中,该方法性能媲美现有有监督最优记忆型方法,且显著优于无记忆方法。在若干挑战性单类增量设置中表现优异,并提供了单类增量TinyImageNet与MiniImageNet的基线结果,为后续研究提供参考。本工作验证了无监督、自适应、拓扑驱动的统计重放机制在持续学习中的有效性,是一种可扩展、灵活的解决方案。
原文摘要 · Abstract (English)
This work presents a generative continual learning framework based on growing self-organizing maps (GSOMs) that are augmented with learned distributional statistics as well as encoder-decoder models for class-incremental learning. The proposed approach enables exemplar-free replay using distributional statistical memory, which eliminates the need to store raw data. Each GSOM unit maintains its own mean, variance, and covariance estimates, which are subsequently used to generate synthetic samples for replay; in encoder-decoder configurations, these samples are then decoded back into the input space (via ancestral sampling) for subsequent training. Our method is fully unsupervised, as it does not rely on explicit task boundaries or class labels during training. Results across multiple benchmarks show that the proposed approach achieves performance competitive even with supervised state-of-the-art memory-based methods while consistently outperforming memory-free approaches. In several settings, our framework matches or exceeds existing baselines, particularly in challenging single-class incremental scenarios. We also provide baseline results for single-class incremental TinyImageNet and MiniImageNet, offering a useful reference for future work. This work highlights the effectiveness of an unsupervised, adaptive, topology-driven neural form of statistical replay as a scalable, flexible approach to continual learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。