模仿大脑记忆机制,让AI更好记住旧知识但学习新任务变慢
Teaching AI to Remember: Insights from Brain-Inspired Replay in Continual Learning
- 用大脑回忆机制重放旧数据特征,缓解模型遗忘
- 搭配记忆保护算法后遗忘率降低,但初期学新任务更慢
- 适合研究如何平衡记忆与学习能力的从业者
人工神经网络在持续学习中仍面临灾难性遗忘问题,即学习新任务时会丢失旧知识。受人类大脑记忆巩固机制启发,本文深入研究内部重放机制——在学习过程中重新激活先前经验的潜在表示。基于此前研究,内部重放被确认为最有效的脑启发组件,因此成为本研究的核心。我们在CIFAR-100的类别增量设置下,评估了内部重放单独使用及与合成智能(SI)结合的效果。实验表明,内部重放显著减轻遗忘,尤其与SI结合时效果更佳,但代价是初始任务准确率下降,揭示了记忆稳定性与学习可塑性之间的权衡。进一步通过对数似然分布、重构误差、轮廓系数和UMAP投影分析发现,内部重放增加了潜在空间中的表示重叠,可能削弱任务间的区分能力。这些结果突显了当前脑启发方法的局限性,并指明未来需在保留能力与适应性之间寻求平衡。
原文摘要 · Abstract (English)
Artificial neural networks (ANNs) continue to face challenges in continual learning, particularly due to catastrophic forgetting, the loss of previously learned knowledge when acquiring new tasks. Inspired by memory consolidation in the human brain, we investigate the internal replay mechanism proposed by~\citep{brain_inspired_replay1}, which reactivates latent representations of prior experiences during learning. As internal replay was identified as the most influential component among the brain-inspired mechanisms in their framework, it serves as the central focus of our in-depth investigation. Using the CIFAR-100 dataset in a class-incremental setting, we evaluate the effectiveness of internal replay, both in isolation and in combination with Synaptic Intelligence (SI). Our experiments show that internal replay significantly mitigates forgetting, especially when paired with SI, but at the cost of reduced initial task accuracy, highlighting a trade-off between memory stability and learning plasticity. Further analyses using log-likelihood distributions, reconstruction errors, silhouette scores, and UMAP projections reveal that internal replay increases representational overlap in latent space, potentially limiting task-specific differentiation. These results underscore the limitations of current brain-inspired methods and suggest future directions for balancing retention and adaptability in continual learning systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。