arXiv:2412.02779cs.LGcs.AI2024-12被引 1

用材料与算法协同优化,让钙钛矿忆阻器高效运行深度神经网络。

Synergistic Development of Perovskite Memristors and Algorithms for Robust Analog Computing

  • 用贝叶斯优化找最佳材料和制备条件,加速忆阻器研发。
  • 开发噪声注入训练法,使神经网络抗忆阻器缺陷能力提升100倍。
  • 适合做低功耗硬件加速的深度学习研究者参考。

基于非易失性忆阻器的模拟计算已成为实现节能深度学习的有前景方案。新型钙钛矿基忆阻器因成本低、能效高、柔性好而受到关注,但材料多样性与工艺不成熟导致器件开发需大量实验。此外,忆阻器固有的非理想特性常阻碍其计算应用。本文提出一种协同方法,同步优化钙钛矿忆阻器制备工艺并开发鲁棒的模拟深度神经网络(DNN),有效应对忆阻器固有缺陷。通过聚焦可用性的贝叶斯优化(BO),高效识别出最优材料与制备条件。同时,提出“BayesMulti”训练策略,利用BO引导的噪声注入,显著提升模拟DNN对忆阻器非理想性的容忍度。理论证明,在一定参数扰动范围内,预测结果保持一致。该集成方法使模拟计算可应用于更深更宽的网络,在图像分类、自动驾驶、物种识别及大规模视觉-语言模型等任务中表现优异,性能最高提升达100倍。进一步在10×10优化钙钛矿忆阻器交叉阵列上验证,分类任务准确率高且能耗极低。本研究为各类模拟计算系统(含器件与算法)的高效优化提供通用解决方案。

原文摘要 · Abstract (English)

Analog computing using non-volatile memristors has emerged as a promising solution for energy-efficient deep learning. New materials, like perovskites-based memristors are recently attractive due to their cost-effectiveness, energy efficiency and flexibility. Yet, challenges in material diversity and immature fabrications require extensive experimentation for device development. Moreover, significant non-idealities in these memristors often impede them for computing. Here, we propose a synergistic methodology to concurrently optimize perovskite memristor fabrication and develop robust analog DNNs that effectively address the inherent non-idealities of these memristors. Employing Bayesian optimization (BO) with a focus on usability, we efficiently identify optimal materials and fabrication conditions for perovskite memristors. Meanwhile, we developed "BayesMulti", a DNN training strategy utilizing BO-guided noise injection to improve the resistance of analog DNNs to memristor imperfections. Our approach theoretically ensures that within a certain range of parameter perturbations due to memristor non-idealities, the prediction outcomes remain consistent. Our integrated approach enables use of analog computing in much deeper and wider networks, which significantly outperforms existing methods in diverse tasks like image classification, autonomous driving, species identification, and large vision-language models, achieving up to 100-fold improvements. We further validate our methodology on a 10$\times$10 optimized perovskite memristor crossbar, demonstrating high accuracy in a classification task and low energy consumption. This study offers a versatile solution for efficient optimization of various analog computing systems, encompassing both devices and algorithms.

忆阻器模拟计算贝叶斯优化深度神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。