arXiv:2604.19343cs.NEcs.LG2026-04被引 1

用新型连接结构让忆阻器计算更快更准,适合长序列分类。

Scalable Memristive-Friendly Reservoir Computing for Time Series Classification

  • 设计并行忆阻友好架构MARS,用减法跳跃连接提升效率。
  • 训练速度最快快21倍,长序列任务性能超LSTM、Mamba等模型。
  • 适合追求低延迟、高能效的硬件部署,尤其适配新兴忆阻芯片。

忆阻器件通过将存储与计算集成于单一物理基底,为下一代信息处理提供可能,具备高效、快速、自适应等优势,尤其适用于深度学习应用。近期提出的忆阻友好回声状态网络(MF-ESN)结合了忆阻动态特性与储备池计算的简单训练方式(仅需训练读出层)。在此基础上,本文提出忆阻友好并行储备池(MARS),一种简化但更高效的架构,通过创新的减法跳跃连接实现高效的可扩展并行计算和更深的模型组合。该设计带来两大优势:相比基础回声状态网络,训练速度最高提升21倍;预测性能显著增强。此外,MARS在多个长序列基准测试中表现卓越,其紧凑的无梯度模型性能大幅超越强梯度序列模型如LRU、S5和Mamba,同时将完整训练时间从数分钟甚至数小时缩短至几秒甚至数百毫秒。本工作确立了并行忆阻友好计算作为可扩展类脑学习系统的重要路径,兼具高预测能力与极高的计算效率,并为在新兴忆阻及存内计算硬件上实现节能、低延迟部署提供了清晰可行方案。

原文摘要 · Abstract (English)

Memristive devices present a promising foundation for next-generation information processing by combining memory and computation within a single physical substrate. This unique characteristic enables efficient, fast, and adaptive computing, particularly well suited for deep learning applications. Among recent developments, the memristive-friendly echo state network (MF-ESN) has emerged as a promising approach that combines memristive-inspired dynamics with the training simplicity of reservoir computing, where only the readout layer is learned. Building on this framework, we propose memristive-friendly parallelized reservoirs (MARS), a simplified yet more effective architecture that enables efficient scalable parallel computation and deeper model composition through novel subtractive skip connections. This design yields two key advantages: substantial training speedups of up to 21x over the inherently lightweight echo state network baseline and significantly improved predictive performance. Moreover, MARS demonstrates what is possible with parallel memristive-friendly reservoir computing: on several long sequence benchmarks our compact gradient-free models substantially outperform strong gradient-based sequence models such as LRU, S5, and Mamba, while reducing full training time from minutes or hours down seconds or even only a few hundred milliseconds. Our work positions parallel memristive-friendly computing as a promising route towards scalable neuromorphic learning systems that combine high predictive capability with radically improved computational efficiency, while providing a clear pathway to energy-efficient, low-latency implementations on emerging memristive and in-memory hardware.

忆阻计算时间序列并行计算类脑硬件

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。