arXiv:2502.17923cs.LG2025-02被引 1

通过改进网络结构提升储层计算的记忆能力。

Techniques for Enhancing Memory Capacity of Reservoir Computing

  • 引入延迟节点链、直通路径与聚类分组策略增强记忆
  • 在NARMA任务上,信息处理容量显著提升,兼顾非线性能力
  • 适用于需高效硬件实现的储层模型,如ESN与CBM-RC

储层计算(Reservoir Computing, RC)是一种受生物启发的机器学习框架,适用于时间序列数据处理,但其记忆容量与非线性之间存在权衡。本文提出三种不修改储层内部结构的方法以提升记忆容量:延迟法通过在输入层添加指定步数的延迟节点链保留历史输入;为抑制输入值增长,将输入权重除以延迟步数;直通法将输入值直接传递至输出层;聚类法将输入与储层节点分组并在输出层融合。我们将这些方法应用于典型RC模型——回声状态网络(ESN)和可高效集成于芯片的混沌玻尔兹曼机-储层计算(CBM-RC),在NARMA任务上评估性能,并以信息处理容量(IPC)衡量记忆容量与非线性之间的平衡。实验表明,所提方法有效提升了记忆能力。

原文摘要 · Abstract (English)

Reservoir Computing (RC) is a bio-inspired machine learning framework, and various models have been proposed. RC is a well-suited model for time series data processing, but there is a trade-off between memory capacity and nonlinearity. In this study, we propose methods to improve the memory capacity of reservoir models by modifying their network configuration except for the inside of reservoirs. The Delay method retains past inputs by adding delay node chains to the input layer with the specified number of delay steps. To suppress the effect of input value increase due to the Delay method, we divide the input weights by the number of added delay steps. The Pass through method feeds input values directly to the output layer. The Clustering method divides the input and reservoir nodes into multiple parts and integrates them at the output layer. We applied these methods to an echo state network (ESN), a typical RC model, and the chaotic Boltzmann machine (CBM)-RC, which can be efficiently implemented in integrated circuits. We evaluated their performance on the NARMA task, and measured information processing capacity (IPC) to evaluate the trade-off between memory capacity and nonlinearity.

储层计算记忆容量非线性ESN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。