在脉冲神经网络中加入类星形胶质细胞,提升学习效率。
Characterizing Learning in Spiking Neural Networks with Astrocyte-Like Units
- 引入类星形胶质细胞单元,模拟其跨长时间尺度的信息处理机制。
- 当类星形细胞与神经元比例约为2:1时,学习速率最高。
- 结果暗示生物真实比例对模型性能有关键影响,适合脑启发计算研究者。
传统人工神经网络借鉴生物网络结构,采用分层的类神经元节点传递信息。更真实的模型引入脉冲特性,以更贴近神经电活动。然而,大脑中大量细胞为胶质细胞,尤其是星形胶质细胞,可能参与计算。本文提出一种改进的脉冲神经网络模型,在其中加入类星形胶质细胞单元,并评估其对学习的影响。将网络实现为液体状态机,任务为混沌时间序列预测。通过调整神经元与类星形胶质细胞单元的数量及比例,研究其对学习效果的作用。结果显示,神经元与类星形胶质细胞共同存在时的学习表现显著优于仅含单一类型单元的网络。有趣的是,当类星形胶质细胞与神经元的比例约为2:1时,学习速率达到最高,该比例接近生物学中星形胶质细胞与神经元的实际估计比值。结果表明,引入可跨长时间尺度表征信息的类星形胶质细胞单元能有效改变神经网络的学习速率,且其比例需针对具体任务进行合理调优。
原文摘要 · Abstract (English)
Traditional artificial neural networks take inspiration from biological networks, using layers of neuron-like nodes to pass information for processing. More realistic models include spiking in the neural network, capturing the electrical characteristics more closely. However, a large proportion of brain cells are of the glial cell type, in particular astrocytes which have been suggested to play a role in performing computations. Here, we introduce a modified spiking neural network model with added astrocyte-like units in a neural network and asses their impact on learning. We implement the network as a liquid state machine and task the network with performing a chaotic time-series prediction task. We varied the number and ratio of neuron-like and astrocyte-like units in the network to examine the latter units effect on learning. We show that the combination of neurons and astrocytes together, as opposed to neural- and astrocyte-only networks, are critical for driving learning. Interestingly, we found that the highest learning rate was achieved when the ratio between astrocyte-like and neuron-like units was roughly 2 to 1, mirroring some estimates of the ratio of biological astrocytes to neurons. Our results demonstrate that incorporating astrocyte-like units which represent information across longer timescales can alter the learning rates of neural networks, and the proportion of astrocytes to neurons should be tuned appropriately to a given task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。