arXiv:2605.30638cs.LGcs.AI2026-05

提出统一框架,让神经网络用输出信号反向传播误差,无需权重回传。

Score Broadcast and Decorrelation: A General Framework for Broadcast-Based Credit Assignment

论文配图:Score Broadcast and Decorrelation: A General Framework for Broadcast-Based Credit Assignment
图 1 · 摘自论文原文
  • 以损失梯度为广播信号,通过正交性原理实现误差反传
  • 在CIFAR-10和Tiny ImageNet上优于现有方法,拓展信号可进一步提升性能
  • 理论支持神经科学中的三因子学习规则,适合研究类脑计算者

我们提出评分广播与去相关(SBD)框架,为通用可微损失函数提供基于广播的信用分配机制。该方法以输出评分(损失对最终层输出的梯度)作为广播信号,建立输出评分与隐藏层激活之间的正交性原则,该原则在最优评分条件期望为零时成立。这一统一原理覆盖了交叉熵、Bregman散度、恰当评分规则及指数族负对数似然等标准损失类型。框架为神经调制因子作为广播损失评分提供了理论依据,并推导出交叉熵情形下的具体形式,定义了可接受的损失类别。我们引入评分向量展开技术,在保持正交结构的前提下增强广播信号。在CIFAR-10和Tiny ImageNet上的实验表明,SBD显著优于现有广播方法,且评分向量展开带来进一步提升。本工作揭示了损失评分是应广播的核心信号,建立了正交性理论基础,为神经科学中的三因子学习规则提供支撑,并说明评分向量展开如何丰富目标函数的去相关方向。

原文摘要 · Abstract (English)

We introduce Score Broadcast and Decorrelation (SBD), a principled framework for broadcast-based credit assignment for general families of differentiable losses. Error broadcast is a biologically plausible alternative to backpropagation that sends output information to hidden layers without weight transport. The Error Broadcast and Decorrelation (EBD) framework, recently introduced for the mean-squared-error (MSE) setting, grounded this mechanism in the stochastic orthogonality of optimal estimators, under which the optimal residual is orthogonal to functions of the input. We generalize that foundation by introducing an orthogonality principle between the output score (the gradient of loss with respect to the final-layer output) and hidden-layer activations, which holds whenever the optimal score has conditional mean zero. This single principle unifies broadcast-based credit assignment across the standard differentiable-loss families, including cross-entropy, Bregman divergences, proper scoring rules, and exponential-family negative log-likelihoods. The framework supplies a theoretical grounding for the three-factor learning rule under general losses, with the neuromodulatory factor derived as the broadcast loss score. We derive the cross-entropy case explicitly, characterize the admissible loss class, and introduce a score vector expansion technique that enriches the broadcast signal while preserving the orthogonality framework. Experiments on CIFAR-10 and Tiny ImageNet show that SBD substantially improves over existing broadcast approaches, with score vector expansion delivering further gains. Overall, this work identifies the loss score as the signal to broadcast, supplies the orthogonality theory and theoretical grounding for the three-factor learning rule from neuroscience, and shows how score vector expansion enriches the decorrelation directions of the resulting objective.

类脑计算信用分配广播机制正交性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。