arXiv:2608.06963cs.AI2026-08

用非负信号模拟反向传播,实现符合生物规律的深度学习。

Learning in Deep Networks under Dale's Constraint

论文配图:Learning in Deep Networks under Dale's Constraint
图 1 · 摘自论文原文
  • 通过正负通道分离表示学习信号,避免混合符号
  • 在Tiny ImageNet上优于传统网络,性能提升显著
  • 适合研究生物可解释性神经网络的人群

生物合理的学习模型旨在解释神经回路如何在真实神经元的约束下实现有效学习。尽管已有重要进展,但一个主要挑战是现有模型常允许神经元或突触表示正负混合值,违反了皮层回路的基本原则——达勒定律:生物神经元要么兴奋,要么抑制,不能兼具;突触无法改变极性。本文提出一种生物启发的神经架构,其中神经激活和学习信号均以非负活动表示,突触具有固定极性,但仍支持类似反向传播的学习。该方法利用两个互补的非负通道分别表示正负贡献,灵感来自大脑中存在‘开-关’表征的证据。这些通道通过简单神经回路模组实现,并在自底向上和自顶向下通路中重复使用。结合局部希伯学习规则,模型仅通过神经元间的局部互动即可传播学习信号并更新权重。理论上证明,该学习方案能精确恢复反向传播更新,即使仅依赖非负误差信号。实验表明,该‘开-关’架构在满足更强生物约束的同时,学习出高效表征,在Tiny ImageNet基准上显著优于对比的普通网络。结果表明,无需混合符号信号,有效的学习仍可从生物合理机制中涌现,为更真实的神经计算模型迈出一步。

原文摘要 · Abstract (English)

Biologically plausible learning models aim to explain how neural circuits can implement effective learning under the constraints of real neurons. Although significant progress has been made, a major remaining challenge is that existing models often allow neurons or synapses to represent mixed-sign values, both positive and negative, in violation of a basic aspect of cortical circuitry -- Dale's constraint: biological neurons are either excitatory or inhibitory, but not both, and synapses cannot change sign. In this work, we address this discrepancy by introducing a biologically motivated neural architecture in which both neural activations and learning signals are represented by non-negative activity, and synapses have fixed sign, while still supporting backpropagation-like learning. Our approach uses two complementary interacting non-negative channels to represent positive and negative contributions, inspired by evidence of on-off representations in the brain. These channels are implemented through a simple neural circuit motif, which is repeated throughout the network in both bottom-up and top-down pathways. Combined with a local Hebbian learning rule, the resulting model propagates learning signals and updates weights using only local interactions between neurons. We show theoretically that our learning scheme can exactly recover the backpropagation update despite relying solely on non-negative error signals. Empirically, beyond satisfying stronger biological constraints, the on-off architecture learns efficient representations, yielding substantial gains over comparable vanilla networks on the Tiny ImageNet benchmark. These results demonstrate that effective learning can emerge from biologically plausible mechanisms without requiring mixed-sign signals, providing a step toward more realistic models of neural computation.

生物神经网络反向传播非负表示达勒定律

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。