arXiv:2507.11393cs.LG2025-07中稿 · CogSci 2025被引 1

用神经网络模拟大脑记忆的分离与补全,实现持续学习不遗忘。

A Neural Network Model of Complementary Learning Systems: Pattern Separation and Completion for Continual Learning

  • 结合变分自编码器与现代霍普菲尔德网络,模拟记忆分离与补全机制。
  • 在Split-MNIST上达到近90%准确率,显著减少遗忘。
  • 适合研究持续学习、神经记忆模型的学者参考。

人类智能的核心是学习新知识而不遗忘旧知识,而神经网络模型常因灾难性遗忘导致旧任务性能严重下降。互补学习系统(CLS)理论解释了这一能力,认为大脑存在两个分工系统:模式分离(编码独立记忆)与模式补全(从部分线索中检索完整记忆)。为捕捉这种互补功能,我们利用变分自编码器(VAEs)的表征泛化能力和现代霍普菲尔德网络(MHNs)的鲁棒记忆存储特性,构建了一个神经上合理且可扩展的持续学习模型。在流行的Split-MNIST基准上评估,该模型达到接近最先进的准确率(约90%),显著降低遗忘。表征分析实证验证了功能分离:VAE支持模式补全,而MHN驱动模式分离。本工作为生物与人工系统中的记忆巩固、泛化与持续学习提供了功能性模板。

原文摘要 · Abstract (English)

Learning new information without forgetting prior knowledge is central to human intelligence. In contrast, neural network models suffer from catastrophic forgetting: a significant degradation in performance on previously learned tasks when acquiring new information. The Complementary Learning Systems (CLS) theory offers an explanation for this human ability, proposing that the brain has distinct systems for pattern separation (encoding distinct memories) and pattern completion (retrieving complete memories from partial cues). To capture these complementary functions, we leverage the representational generalization capabilities of variational autoencoders (VAEs) and the robust memory storage properties of Modern Hopfield networks (MHNs), combining them into a neurally plausible continual learning model. We evaluate this model on the Split-MNIST task, a popular continual learning benchmark, and achieve close to state-of-the-art accuracy (~90%), substantially reducing forgetting. Representational analyses empirically confirm the functional dissociation: the VAE underwrites pattern completion, while the MHN drives pattern separation. By capturing pattern separation and completion in scalable architectures, our work provides a functional template for modeling memory consolidation, generalization, and continual learning in both biological and artificial systems.

持续学习记忆模型模式分离神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。