arXiv:2605.30372cs.NEcs.AI2026-05

用进化算法自动优化神经网络结构,提升时序学习效果。

Evolutionary Algorithm for Reservoir Learning and Yielding

论文配图:Evolutionary Algorithm for Reservoir Learning and Yielding
图 1 · 摘自论文原文
  • 以脑部模块化结构为灵感,用基因演化搜索最优网络拓扑和参数。
  • 在CogScale数据集上,进化出的结构比随机搜索更优,且复杂任务对应更复杂的模块化设计。
  • 结果可复用,适合需要通用时序建模能力的研究者。

储备计算是一种循环神经网络,因其将动态处理与可训练读出层分离,在时序学习中具有潜力。然而,经典回声状态网络(ESN)通常需针对特定任务调参才能获得良好性能。本文提出EARLY(基于进化算法的储备学习与产出框架),用于演化多储备ESN的拓扑结构与超参数。受大脑模块化组织启发,EARLY将网络结构编码为图基因组,通过交叉、变异和选择发现高效配置。目标是构建通用架构并促进泛化能力。该方法在CogScale数据集的时序学习任务上进行评估。结果显示,进化所得架构在多个任务中优于随机搜索结果,且结构差异随任务难度变化:简单任务产生轻量结构,复杂任务则偏好更丰富的模块化组织。这表明进化搜索有助于识别可复用于多种时序问题的储备结构。进一步在跨情境学习数据集上评估,验证其适应新环境的能力。

原文摘要 · Abstract (English)

Reservoir computing, a type of recurrent neural network, is a promising approach for temporal learning as it separates dynamic processing from the trained readout layer. However, classical Echo State Networks (ESNs) often require task-specific tuning of their architecture and hyperparameters to achieve good performance. This paper introduces EARLY (Evolutionary Algorithm for Reservoir Learning and Yielding), a framework designed to evolve both the topology and hyperparameters of multi-reservoir ESNs. Inspired by the modular organisation of the brain, EARLY encodes architectures as graph-based genomes and applies crossover, mutation, and selection to discover effective configurations. Our goal is to create both generic architectures and tasks inducing generalization. The method is evaluated on temporal learning tasks from the CogScale dataset. Results show that evolved architectures outperform those obtained with random search on several tasks and exhibit structural differences depending on task difficulty: simpler tasks yield lightweight architectures, while more complex tasks favour richer modular organisations. These findings suggest that evolutionary search can help identify reusable reservoir structures for a broader range of temporal problems. The evolved architectures are further evaluated on a cross-situational learning dataset to assess their ability to adapt to new environments.

神经网络演化时序建模储备计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。