arXiv:2605.08135cs.LG2026-05被引 3

用树突结构提升类脑学习算法在复杂任务中的表现。

Dendritic Neural Networks with Equilibrium Propagation

论文配图:Dendritic Neural Networks with Equilibrium Propagation
图 1 · 摘自论文原文
  • 将树突神经网络与平衡传播结合,改进类脑学习机制。
  • 在更深模型和更难数据集上显著优于传统平衡传播。
  • 适合研究类脑计算、神经架构设计的学者参考。

平衡传播(EP)是一种生物可解释的反向传播替代方法,但在深层或复杂学习场景中性能可能下降。与此同时,使用反向传播训练的树突神经网络展现出更好的性能和泛化能力,表明结构化的生物启发架构能提升学习效果。本文将树突神经网络与先进的平衡传播框架结合,评估其在MNIST、Kuzushiji-MNIST(KMNIST)和Fashion-MNIST(FMNIST)上的表现,涵盖浅层与深层结构。结果表明,树突平衡传播在简单任务中表现接近标准EP,而在更复杂的数据集和更深的模型中则持续提升;尤其在KMNIST和FMNIST上显著超越标准EP,接近使用时间反向传播训练的树突网络性能。进一步分析自由阶段隐藏状态演化发现,树突EP具有更高的激活幅度和更分散的内部活动,说明树突结构改变了网络动态。这些结果表明,引入树突结构可有效增强生物可解释学习算法在挑战性场景下的表现,凸显架构设计对类脑训练方法的关键作用。

原文摘要 · Abstract (English)

Equilibrium propagation (EP) is a biologically plausible alternative to backpropagation (BP), but its effectiveness can degrade in deeper and more challenging learning settings. In parallel, dendritic neural networks have demonstrated improved performance and generalization when trained with BP, suggesting that structured, biologically inspired architectures may enhance learning. In this work, we investigate the integration of dendritic neural networks with equilibrium propagation using an advanced EP framework. We evaluate the proposed dendritic EP model on MNIST, Kuzushiji-MNIST (KMNIST), and Fashion-MNIST (FMNIST), considering both shallow and deeper architectures. Our results show that dendritic EP achieves performance comparable to standard EP on simple tasks, while providing consistent improvements on more challenging datasets and deeper models. In particular, dendritic EP significantly outperforms standard EP on KMNIST and FMNIST, and approaches the performance of dendritic networks trained with backpropagation through time.To further understand these improvements, we analyze the evolution of hidden states during the free phase. We observe that dendritic EP exhibits higher activation magnitudes and more distributed hidden-state activity compared to standard EP, indicating that dendritic structure alters the internal network dynamics. These findings suggest that incorporating dendritic structure can enhance the effectiveness of biologically plausible learning algorithms, especially in regimes where standard EP struggles. Our work highlights the importance of architectural design for improving biologically inspired training methods.

类脑计算树突网络平衡传播神经架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。