提出自适应硬件的忆阻器联想记忆,容量提升3倍且抗故障。
Hardware-Adaptive and Superlinear-Capacity Memristor-based Associative Memory
- 设计自适应学习算法,动态补偿硬件缺陷
- 50%器件故障下容量达3倍于现有方法,支持连续模式
- 多层架构实现超线性扩展,适合高容量低功耗场景
类脑计算旨在模拟联想记忆等认知功能,即从部分线索中回忆完整模式。忆阻器技术因其支持高效存内模拟计算,被视为神经形态系统的重要硬件基础。霍普菲尔德神经网络(HNN)是经典的联想记忆模型,但传统硬件实现存在效率瓶颈,而先前基于忆阻器的HNN面临离线训练导致的硬件缺陷敏感、存储容量有限及难以处理模拟模式的问题。本文在集成忆阻器硬件上提出并实验验证了一种新型硬件自适应学习算法,显著提升缺陷容错能力与存储容量,并自然扩展至可扩展的多层架构,可处理二值与连续模式。该方法在50%器件故障下实现3倍有效容量,相比现有方法;其多层扩展使二值模式容量呈超线性增长(∝N^1.49),连续模式召回能力达∝N^1.74,远超以往线性扩展。同时可通过调节隐层神经元灵活调整容量。利用硬件同步更新带来的大规模并行性,相比异步方案,64维模式下能耗降低8.8倍,延迟减少99.7%,规模越大优势越明显。这为构建更可靠、高效、灵活的忆阻器联想记忆系统铺平道路,推动新应用研究。
原文摘要 · Abstract (English)
Brain-inspired computing aims to mimic cognitive functions like associative memory, the ability to recall complete patterns from partial cues. Memristor technology offers promising hardware for such neuromorphic systems due to its potential for efficient in-memory analog computing. Hopfield Neural Networks (HNNs) are a classic model for associative memory, but implementations on conventional hardware suffer from efficiency bottlenecks, while prior memristor-based HNNs faced challenges with vulnerability to hardware defects due to offline training, limited storage capacity, and difficulty processing analog patterns. Here we introduce and experimentally demonstrate on integrated memristor hardware a new hardware-adaptive learning algorithm for associative memories that significantly improves defect tolerance and capacity, and naturally extends to scalable multilayer architectures capable of handling both binary and continuous patterns. Our approach achieves 3x effective capacity under 50% device faults compared to state-of-the-art methods. Furthermore, its extension to multilayer architectures enables superlinear capacity scaling (\(\propto N^{1.49}\ for binary patterns) and effective recalling of continuous patterns (\propto N^{1.74}\ scaling), as compared to linear capacity scaling for previous HNNs. It also provides flexibility to adjust capacity by tuning hidden neurons for the same-sized patterns. By leveraging the massive parallelism of the hardware enabled by synchronous updates, it reduces energy by 8.8x and latency by 99.7% for 64-dimensional patterns over asynchronous schemes, with greater improvements at scale. This promises the development of more reliable memristor-based associative memory systems and enables new applications research due to the significantly improved capacity, efficiency, and flexibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。