突破传统神经网络限制,用不稳定物理系统实现可靠计算
Reservoir Computing Generalized
- 反向设计:不依赖输入重复响应,让随机性物质也能当计算资源
- 实验证明非规则振子可处理信息并还原输入,输出稳定可靠
- 适用于混沌系统等难用物理现象,拓展了硬件计算材料范围
物理神经网络(PNN)兼具解决机器学习任务的潜力与高速、低功耗等固有物理特性。共振计算(RC)是通过动态系统结合训练读出层来实现信息处理的优秀框架,加速了非常规材料在PNN中的应用。但传统RC要求系统对相同输入产生可重复响应,限制了可用物质类型。本文提出广义共振计算(GRC)框架,将此要求反转,使传统RC成为特例。我们利用对相同输入响应不一致的物质(如自旋扭矩振荡器),提出机制确保输出可靠性,并证明在非传统物质中处理过的输入仍可被恢复。最终,基于该框架,原本被认为不可用的时空混沌被用于模拟复杂非线性动力学,包括大规模时空混沌。本框架突破了构建信息处理器的限制,为使用更广泛物理动力学构造计算系统开辟新路径。
原文摘要 · Abstract (English)
A physical neural network (PNN) has both the strong potential to solve machine learning tasks and intrinsic physical properties, such as high-speed computation and energy efficiency. Reservoir computing (RC) is an excellent framework for implementing an information processing system with a dynamical system by attaching a trained readout, thus accelerating the wide use of unconventional materials for a PNN. However, RC requires the dynamics to reproducibly respond to input sequence, which limits the type of substance available for building information processors. Here we propose a novel framework called generalized reservoir computing (GRC) by turning this requirement on its head, making conventional RC a special case. Using substances that do not respond the same to identical inputs (e.g., a real spin-torque oscillator), we propose mechanisms aimed at obtaining a reliable output and show that processed inputs in the unconventional substance are retrievable. Finally, we demonstrate that, based on our framework, spatiotemporal chaos, which is thought to be unusable as a computational resource, can be used to emulate complex nonlinear dynamics, including large scale spatiotemporal chaos. Overall, our framework removes the limitation to building an information processing device and opens a path to constructing a computational system using a wider variety of physical dynamics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。