arXiv:2601.06758cs.NEcs.LG2026-01

无需反向传播的反馈赫布网络实现持续学习中的记忆再生与共存。

A Backpropagation-Free Feedback-Hebbian Network for Continual Learning Dynamics

  • 用局部规则更新所有突触,结合赫布协方差与监督驱动。
  • 顺序学习时前向连接抑制旧记忆,反馈连接保留旧信息痕迹。
  • 适合研究持续学习机制的可解释性模型,适用于神经动力学分析。

富含反馈的神经架构能重构早期表征并注入时间上下文,是严格局部突触可塑性的理想场景。现有研究质疑:一个极简、无反向传播的反馈赫布系统在受控训练下是否能表现出可解释的持续学习相关行为。本文提出一种紧凑的预测-重建架构,通过专用反馈路径提供轻量级、局部可训练的时间上下文,实现持续适应。所有突触由统一的局部规则更新,融合中心化赫布协方差、Oja式稳定项及本地监督驱动(目标可用)。在双对关联任务中,通过层间活动快照、连接轨迹(权重行/列均值)和归一化保留指数分析学习过程。顺序训练(A→B)下,前向输出连接呈现类似长时程抑制(LTD)的旧关联抑制,而反馈连接在学习B时仍保留与A相关的痕迹。交替序列下,两个关联同时维持而非顺序抑制。架构控制与规则项消融揭示了专用反馈在表征再生与共存中的作用,以及本地监督项在输出选择性与遗忘中的关键角色。结果表明,仅用局部可塑性训练的紧凑反馈路径即可支持再生与持续学习相关动态,且机制透明、结构简洁。

原文摘要 · Abstract (English)

Feedback-rich neural architectures can regenerate earlier representations and inject temporal context, making them a natural setting for strictly local synaptic plasticity. Existing literature raises doubt about whether a minimal, backpropagation-free feedback-Hebbian system can already express interpretable continual-learning-relevant behaviors under controlled training schedules. In this work, we introduce a compact prediction-reconstruction architecture with a dedicated feedback pathway providing lightweight, locally trainable temporal context for continual adaptation. All synapses are updated by a unified local rule combining centered Hebbian covariance, Oja-style stabilization, and a local supervised drive where targets are available. With a simple two-pair association task, learning is characterized through layer-wise activity snapshots, connectivity trajectories (row and column means of learned weights), and a normalized retention index across phases. Under sequential A to B training, forward output connectivity exhibits a long-term depression (LTD)-like suppression of the earlier association, while feedback connectivity preserves an A-related trace during acquisition of B. Under an alternating sequence, both associations are concurrently maintained rather than sequentially suppressed. Architectural controls and rule-term ablations isolate the role of dedicated feedback in regeneration and co-maintenance, alongside the role of the local supervised term in output selectivity and unlearning. Together, the results show that a compact feedback pathway trained with local plasticity can support regeneration and continual-learning-relevant dynamics in a minimal, mechanistically transparent setting.

持续学习反馈网络赫布学习局部可塑性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。