arXiv:2506.06904cs.NEcs.AI2025-06ICML被引 1

e-prop学习规则能让神经网络模拟大脑活动,性能接近反向传播。

Can Biologically Plausible Temporal Credit Assignment Rules Match BPTT for Neural Similarity? E-prop as an Example

  • 用梯度截断的e-prop规则近似反向传播,符合生物约束。
  • 在相同任务准确率下,e-prop与BPTT模型的神经活动相似度相当。
  • 模型结构和初始条件比学习规则更影响神经活动相似性。

理解大脑如何学习,可借助生物上合理的学习规则研究。这类规则通常近似梯度下降以满足局部性等生物限制,需满足两个关键标准:(1)良好的神经科学任务表现,(2)与神经记录数据一致。尽管已有大量研究评估前者,后者仍研究不足。本研究通过在经典神经科学数据集上使用Procrustes分析,证明一种生物合理的学习规则——基于梯度截断的e-prop,能在匹配任务准确率的前提下,实现与反向传播通过时间(BPTT)相当的神经数据相似性。结果还显示,模型架构和初始条件对神经相似性的影响,可能超过具体学习规则本身。此外,在相近准确率下,BPTT训练模型与其生物可实现对应模型表现出相似的动力学特性。这些发现表明,生物可实现学习规则已取得显著进展,具备实现优异任务性能与神经数据相似性的潜力。

原文摘要 · Abstract (English)

Understanding how the brain learns may be informed by studying biologically plausible learning rules. These rules, often approximating gradient descent learning to respect biological constraints such as locality, must meet two critical criteria to be considered an appropriate brain model: (1) good neuroscience task performance and (2) alignment with neural recordings. While extensive research has assessed the first criterion, the second remains underexamined. Employing methods such as Procrustes analysis on well-known neuroscience datasets, this study demonstrates the existence of a biologically plausible learning rule -- namely e-prop, which is based on gradient truncation and has demonstrated versatility across a wide range of tasks -- that can achieve neural data similarity comparable to Backpropagation Through Time (BPTT) when matched for task accuracy. Our findings also reveal that model architecture and initial conditions can play a more significant role in determining neural similarity than the specific learning rule. Furthermore, we observe that BPTT-trained models and their biologically plausible counterparts exhibit similar dynamical properties at comparable accuracies. These results underscore the substantial progress made in developing biologically plausible learning rules, highlighting their potential to achieve both competitive task performance and neural data similarity.

学习规则神经相似性e-prop生物合理性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。