arXiv:2504.12480cs.NEcs.LG2025-04

让神经网络自动调节兴奋抑制平衡,显著提升计算效率与稳定性。

Boosting Reservoir Computing with Brain-inspired Adaptive Dynamics

  • 引入局部自适应机制动态调整神经元的兴奋抑制平衡
  • 在记忆容量和时间序列预测任务中性能提升最高达130%
  • 适合对鲁棒性要求高的实时计算场景或脑启发模型研究者

储层计算(RC)提供了一种计算高效且可融入脑启发计算原则的深度学习替代方案。通过使用具有随机固定连接的内部神经网络(即‘储层’)并仅训练输出权重,RC 简化了训练过程,但对控制激活函数和网络结构的超参数选择仍敏感。此外,典型实现忽略了神经元动力学的关键特征:兴奋与抑制(E-I)信号的平衡,这对稳健的脑功能至关重要。我们发现,当储层处于平衡或轻微抑制状态时,其性能最佳,优于兴奋主导的情形。为减少对精确超参数调优的需求,我们提出一种局部自适应机制,可动态调节 E-I 平衡以达到目标神经元放电率,在记忆容量和时间序列预测等任务中,性能较全局调优的 RC 提升最高达 130%。进一步引入目标放电率的脑启发异质性,可进一步降低对超参数微调的需求,并使 RC 在线性和非线性任务中均表现出色。这些结果支持将储层设计从静态优化转向动态适应,展示了脑启发机制如何提升 RC 的性能与鲁棒性,深化了对神经计算的理解。

原文摘要 · Abstract (English)

Reservoir computers (RCs) provide a computationally efficient alternative to deep learning while also offering a framework for incorporating brain-inspired computational principles. By using an internal neural network with random, fixed connections$-$the 'reservoir'$-$and training only the output weights, RCs simplify the training process but remain sensitive to the choice of hyperparameters that govern activation functions and network architecture. Moreover, typical RC implementations overlook a critical aspect of neuronal dynamics: the balance between excitatory and inhibitory (E-I) signals, which is essential for robust brain function. We show that RCs characteristically perform best in balanced or slightly over-inhibited regimes, outperforming excitation-dominated ones. To reduce the need for precise hyperparameter tuning, we introduce a self-adapting mechanism that locally adjusts E/I balance to achieve target neuronal firing rates, improving performance by up to 130% in tasks like memory capacity and time series prediction compared with globally tuned RCs. Incorporating brain-inspired heterogeneity in target neuronal firing rates further reduces the need for fine-tuning hyperparameters and enables RCs to excel across linear and non-linear tasks. These results support a shift from static optimization to dynamic adaptation in reservoir design, demonstrating how brain-inspired mechanisms improve RC performance and robustness while deepening our understanding of neural computation.

储层计算脑启发自适应动态调节

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。