模拟蚂蚁信息素,让神经网络局部学习且不易遗忘。
Local Pheromone Network: Sparse Local Learning with Multi-Scale Synaptic Trails, Consolidation, and Replay
- 每个神经元只连接局部输入,用信息素痕迹指导权重更新。
- 在冲突任务中减少遗忘,通过重放和结构可塑性保持记忆。
- 适合研究生物启发式学习机制或小规模记忆系统设计。
反向传播训练的密集神经网络虽强大,但参数间耦合紧密,任务冲突时易覆盖旧知识。本文提出局部信息素网络(Local Pheromone Network),一个小型研究原型,实现稀疏、局部、手动更新的神经网络。每个输出单元仅读取固定局部输入邻域,受几何距离与分子标签兼容性约束。每条突触存储权重、短期信息素痕迹、长期信息素痕迹及可选巩固状态。训练不依赖自动微分,各层基于局部误差与共激活,在预算内选择局部突触进行信息素加权的赫布式更新。更新预算在线自适应:损失下降时缩减,损失上升时扩展至近期活跃邻域。附加机制包括结构可塑性、局部重放、输出掩码用于分块学习,以及无目标的局部对比步骤。我们展示了实现、学习规则及初步实验,涵盖合成回归、分块记忆、冲突记忆、巩固冲突、结构可塑性、重放和合成长上下文混合记忆任务。原型能学习局部线性规则,通过标签与掩码保留分块记忆,巩固后减少遗忘,并在冲突下利用重放应对。
原文摘要 · Abstract (English)
Backpropagation-trained dense neural networks are powerful function approximators, but they couple learning across many parameters and can overwrite previous associations when tasks conflict. This paper describes Local Pheromone Network, a small research prototype for sparse, local, manually updated neural networks. In Local Pheromone Network, each output unit reads only a fixed local neighborhood of input units subject to geometric distance and molecular-tag compatibility. Each synapse stores a weight, a short-term pheromone trace, a long-term pheromone trace, and an optional consolidation state. Training does not call automatic differentiation. Instead, every layer performs a pheromone-weighted Hebbian-style update on a budgeted subset of local synapses selected from local error and co-activity. The update budget adapts online: it shrinks when loss improves and expands toward recently active neighborhoods when loss worsens. Optional mechanisms add structural plasticity, local replay, output masks for partitioned learning, and a target-free local contrastive step. We present the implementation, learning rule, and preliminary experiments on synthetic regression, partitioned memory, conflicting memory, consolidated conflict, structural plasticity, replay, and a synthetic long-context hybrid memory task. The prototype learns local linear rules, preserves partitioned memories through tags and masks, reduces forgetting under consolidation, and uses replay under conflict.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。