优化物理储层计算的输出训练策略,提升性能并防过拟合。
Effective Training Principles of Physical Reservoirs

- 通过剪枝与正则化减少输出冗余,降低训练开销。
- 全频段读出选择使非迭代方法性能显著提升。
- L1/L2正则化在复杂任务上表现优异,适合非线性系统。
储层计算机受益于光学现象固有的复杂性,带来丰富且常具非线性的动态特性。然而,直接在储层输出上进行训练易导致过拟合,并在训练阶段造成计算效率低下。本文研究通过输出剪枝与正则化来缓解过拟合、降低计算开销的策略。对比了损失最小化搜索方法(等量搜索与分支定界)与输出导向的统计过滤方法(方差筛选)及随机剪枝,分析各自优劣,强调在潜空间缩小背景下有意识地采样输出的重要性。进一步表明,在整个输出频谱上强制读出选择可提升性能,尤其对非迭代方法有效。同时检验了L1与L2正则化技术(LASSO与岭回归),两者在如螺旋基准测试等高度非线性任务中均显著提升性能。尽管方法具普适性,实验以非线性光纤极端学习机为例展开分析。本研究深入揭示了储层隐层滤波机制与输出层训练的关键作用,为物理储层计算系统实现最优性能提供支持。
原文摘要 · Abstract (English)
Reservoir computers benefit from the inherent complexity of optical phenomena, which provide rich, often nonlinear dynamics. However, training directly on the reservoir's output renders the system prone to overfitting and computationally inefficient during the training phase. In this work, we investigate strategies to mitigate overfitting and reduce computational overhead through output pruning and regularization. We compare loss-minimizing search methods (Equal Search and Branch and Bound) against an output-oriented statistical filtering approach (Variance Filter) and random pruning, highlighting advantages and disadvantages of each approach and the overall importance of informed reservoir output sampling, particularly for a shrinking latent space. We further demonstrate that enforcing readout selection across the full output spectrum improves performance, especially for non-iterative methods. Additionally, we examine L1 and L2 regularization techniques (LASSO and ridge regression), both of which significantly enhance performance on highly nonlinear tasks such as the Spiral Benchmark. While our methods are of general use, results are obtained from and discussed exemplarily for a nonlinear fiber-optical extreme learning machine. Overall, this study provides a deep analysis of the reservoirs' hidden-layer filtering mechanisms and the output-layer training, enabling optimized performance in physical reservoir computing systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。