用电压调控突触可塑性实现低功耗边缘神经网络的无监督在线学习。
Unsupervised local learning based on voltage-dependent synaptic plasticity for resistive and ferroelectric synapses
- 基于电压依赖的突触可塑性,无需复杂电路即可实现无监督本地学习。
- 在三种忆阻器件上均达超83%准确率,200个神经元下性能领先。
- 适合边缘计算、低功耗神经形态芯片设计者参考。
将AI部署于边缘计算设备面临能耗与功能性的挑战。此类设备可显著受益于类脑学习机制,在低功耗下实现实时自适应。基于纳米级电阻存储器的存内计算有望推动AI工作负载在边缘设备上的执行。本研究提出电压依赖的突触可塑性(VDSP),一种基于赫布原则的高效无监督局部学习方法,适用于忆阻突触。该方法避免了传统脉冲时序依赖可塑性(STDP)所需的复杂脉冲整形电路,可适配三类不同开关特性的忆阻器件:TiO₂、基于HfO₂的金属氧化物丝状突触及基于HfZrO₄的铁电隧道结(FTJ)。系统级仿真验证了含这些器件的脉冲神经网络在基于MNIST的模式识别任务中的无监督学习能力,所有器件在200个神经元下均实现超过83%的准确率。此外,评估了器件变异(如开关阈值、高低阻态比)的影响,并提出缓解策略以增强鲁棒性。
原文摘要 · Abstract (English)
The deployment of AI on edge computing devices faces significant challenges related to energy consumption and functionality. These devices could greatly benefit from brain-inspired learning mechanisms, allowing for real-time adaptation while using low-power. In-memory computing with nanoscale resistive memories may play a crucial role in enabling the execution of AI workloads on these edge devices. In this study, we introduce voltage-dependent synaptic plasticity (VDSP) as an efficient approach for unsupervised and local learning in memristive synapses based on Hebbian principles. This method enables online learning without requiring complex pulse-shaping circuits typically necessary for spike-timing-dependent plasticity (STDP). We show how VDSP can be advantageously adapted to three types of memristive devices (TiO$_2$, HfO$_2$-based metal-oxide filamentary synapses, and HfZrO$_4$-based ferroelectric tunnel junctions (FTJ)) with disctinctive switching characteristics. System-level simulations of spiking neural networks incorporating these devices were conducted to validate unsupervised learning on MNIST-based pattern recognition tasks, achieving state-of-the-art performance. The results demonstrated over 83% accuracy across all devices using 200 neurons. Additionally, we assessed the impact of device variability, such as switching thresholds and ratios between high and low resistance state levels, and proposed mitigation strategies to enhance robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。