用生成模型模拟大脑睡眠,避免遗忘且不存原始数据。
MyGO: Memory Yielding Generative Offline-consolidation for Lifelong Learning Systems
- 学习新任务后生成压缩版数据模型,睡觉时用它‘做梦’巩固记忆。
- 在图像和文本任务上平均准确率超基线,遗忘率大幅降低。
- 适合隐私敏感或存储受限的长期学习场景。
持续学习旨在让模型在不断接收新任务的过程中,不忘记旧知识。现有方法多依赖存储旧任务样本(经验回放)或使用复杂正则项保护权重,但面临数据隐私、存储限制及任务差异大时性能下降的问题。为此,我们提出 MyGO(Memory Yielding Generative Offline-consolidation),受生物清醒-睡眠周期启发。在‘清醒’阶段,系统快速学习新任务,并训练一个紧凑的生成模型(生成记忆,G-mem)以捕捉其数据分布;在‘睡眠’阶段,系统进入离线状态,利用所有已学的 G-mem 模型生成伪数据(‘梦境’),并通过知识蒸馏将新旧知识融合进核心特征提取器。该方法无需存储任何原始数据,仅保留轻量生成模型,显著提升隐私与存储效率。我们在计算机视觉(Split-MNIST)和自然语言处理(Split-AG News)基准上评估 MyGO,对比顺序微调基线。结果表明,MyGO 显著缓解灾难性遗忘,在跨任务平均准确率上表现优异,验证了框架的有效性与领域通用性。
原文摘要 · Abstract (English)
Continual or Lifelong Learning aims to develop models capable of acquiring new knowledge from a sequence of tasks without catastrophically forgetting what has been learned before. Existing approaches often rely on storing samples from previous tasks (experience replay) or employing complex regularization terms to protect learned weights. However, these methods face challenges related to data privacy, storage limitations, and performance degradation when tasks are dissimilar. To address these challenges, we introduce MyGO (Memory Yielding Generative Offline-consolidation), a novel lifelong learning framework inspired by the biological wake-sleep cycle. During the "wake" phase, the system rapidly learns a new task and trains a compact generative model (Generative Memory, G-mem) to capture its data distribution. During the "sleep" phase, the system enters an offline state, using all learned G-mem models to generate pseudo-data ("dreams") and consolidate new and old knowledge into a core feature extractor via knowledge distillation. This approach obviates the need to store any raw data, retaining only compact generative models, which offers significant advantages in privacy and storage efficiency. We evaluate MyGO on computer vision (Split-MNIST) and natural language processing (Split-AG News) benchmarks, comparing it against a sequential fine-tuning baseline. The results demonstrate that MyGO significantly mitigates catastrophic forgetting and maintains high average accuracy across tasks, proving the framework's effectiveness and domain-generality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。