arXiv:2508.16651cs.LGcs.AI2025-08AAAI被引 1

受海马体启发的双记忆模型,缓解持续学习中的灾难性遗忘。

HiCL: Hippocampal-Inspired Continual Learning

  • 模仿海马体结构设计双记忆系统,用稀疏模式分离与自关联存储。
  • 在多个任务上实现接近顶尖性能,计算开销更低。
  • 适合研究生物启发的持续学习或需高效多任务处理的场景。

我们提出HiCL,一种受海马体启发的双记忆持续学习架构,旨在通过模拟海马体回路减轻灾难性遗忘。系统通过类网格细胞层编码输入,再经受齿状回启发的top-k稀疏模式分离模块进行稀疏化处理。情景记忆以类似CA3的自关联记忆形式保存。任务特定处理由DG门控专家混合机制动态管理,输入根据其归一化稀疏DG表示与在线指数移动平均计算的任务原型之间的余弦相似度路由至对应专家。该生物基础且数学严谨的门控策略实现了可微、可扩展的任务路由,无需独立门控网络,提升了模型在顺序学习中的适应性与效率。皮层输出通过基于任务间相似性的弹性权重整合进行巩固。关键的是,引入优先重放机制强化关键过往经验。在标准持续学习基准上的评估表明,该架构有效降低任务干扰,在更低计算成本下达到近顶尖性能。代码已开源。

原文摘要 · Abstract (English)

We propose HiCL, a novel hippocampal-inspired dual-memory continual learning architecture designed to mitigate catastrophic forgetting by using elements inspired by the hippocampal circuitry. Our system encodes inputs through a grid-cell-like layer, followed by sparse pattern separation using a dentate gyrus-inspired module with top-k sparsity. Episodic memory traces are maintained in a CA3-like autoassociative memory. Task-specific processing is dynamically managed via a DG-gated mixture-of-experts mechanism, wherein inputs are routed to experts based on cosine similarity between their normalized sparse DG representations and learned task-specific DG prototypes computed through online exponential moving averages. This biologically grounded yet mathematically principled gating strategy enables differentiable, scalable task-routing without relying on a separate gating network, and enhances the model's adaptability and efficiency in learning multiple sequential tasks. Cortical outputs are consolidated using Elastic Weight Consolidation weighted by inter-task similarity. Crucially, we incorporate prioritized replay of stored patterns to reinforce essential past experiences. Evaluations on standard continual learning benchmarks demonstrate the effectiveness of our architecture in reducing task interference, achieving near state-of-the-art results in continual learning tasks at lower computational costs. Our code is available here https://github.com/kushalk173-sc/HiCL.

持续学习生物启发双记忆高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。