arXiv:2604.06395cs.LGq-bio.NC2026-04

提出鲁棒区间概念,解决脉冲神经网络调参难题。

Bridging Theory and Practice in Crafting Robust Spiking Reservoirs

  • 定义鲁棒区间:参数在该范围内性能稳定不下降
  • 发现连接稀疏度和阈值越高,鲁棒区间越窄
  • 证明临界点权重是可靠的调参起点,适合工程应用

脉冲储备池计算具有低功耗优势,但因实验不确定性,使系统在混沌边缘稳定运行难以实现。本文通过引入并分析‘鲁棒区间’——即在任务阈值之上保持性能的超参数范围——弥合理论与实践的差距。在静态(MNIST)和时序(合成球轨迹)任务上对漏电积分-发放(LIF)架构系统评估发现,鲁棒区间宽度随突触前连接密度β(即稀疏度)和发放阈值θ增加而减小。我们识别出一组保持解析均场临界点w_crit的(β, θ)组合,揭示了超参数空间中的等性能曲面。在Erdős-Rényi图上的控制实验表明该现象不限于小世界拓扑。结果还显示,理论临界点w_crit始终位于高表现区域,验证其作为参数搜索起始点的鲁棒性。代码已公开以确保可复现性。

原文摘要 · Abstract (English)

Spiking reservoir computing provides an energy-efficient approach to temporal processing, but reliably tuning reservoirs to operate at the edge-of-chaos is challenging due to experimental uncertainty. This work bridges abstract notions of criticality and practical stability by introducing and exploiting the robustness interval, an operational measure of the hyperparameter range over which a reservoir maintains performance above task-dependent thresholds. Through systematic evaluations of Leaky Integrate-and-Fire (LIF) architectures on both static (MNIST) and temporal (synthetic Ball Trajectories) tasks, we identify consistent monotonic trends in the robustness interval across a broad spectrum of network configurations: the robustness-interval width decreases with presynaptic connection density $β$ (i.e., directly with sparsity) and directly with the firing threshold $θ$. We further identify specific $(β, θ)$ pairs that preserve the analytical mean-field critical point $w_{\text{crit}}$, revealing iso-performance manifolds in the hyperparameter space. Control experiments on Erdős-Rényi graphs show the phenomena persist beyond small-world topologies. Finally, our results show that $w_{\text{crit}}$ consistently falls within empirical high-performance regions, validating $w_{\text{crit}}$ as a robust starting coordinate for parameter search and fine-tuning. To ensure reproducibility, the full Python code is publicly available.

脉冲神经网络储备池计算鲁棒性参数优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。