让神经网络在高温下仍保持高精度,还能省电5.4倍。
ThRIve: Thermally Robust CNN Inference via Low-Rank Adaptation in Heterogeneous PIM Architectures
- 用低秩参数动态补偿内存受热干扰的误差
- 温度变化时精度波动不超过2%,平均精度接近无噪声理想值
- 适合部署在易受温度影响的存算一体芯片上
存算一体(PIM)技术有望加速机器学习任务,尤其基于非易失性内存的PIM架构可通过高效矩阵-向量乘法实现节能计算。然而,这类器件易受热噪声影响,导致存储权重的单元值偏移,降低推理精度。本文提出ThRIve,一种面向异构PIM架构的抗热噪声训练方法,通过低秩适配技术将敏感参数存于抗热性更强的硬件中,有效应对温度引起的噪声波动。实验表明,使用ThRIve的系统在全温域内推理精度稳定,均值精度与理想情况相差不超过2%,温度变化带来的精度波动也控制在2%以内。该方法达到与抗热SRAM-PIM相当的鲁棒性,同时在卷积神经网络推理中实现高达5.4倍的能效延迟积(EDP)降低。
原文摘要 · Abstract (English)
Processing-In-Memory (PIM) has emerged as a promising technology for accelerating machine learning (ML) workloads. Specifically, non-volatile memory-based PIM architectures have enabled effective ML acceleration due to their ability to perform energy-efficient matrix-vector multiplication operations. However, these devices suffer from non-idealities such as thermal noise. This noise alters the stored values in the memory cells which correspond to actual model weights, compromising the inference accuracy. In this work, we introduce ThRIve, a noise-aware training methodology that leverages low-rank adaptation to enable thermally robust inference on heterogeneous PIM architectures. ThRIve selectively stores these low-rank noise-aware parameters on a hardware that is less susceptible to thermal noise, enabling robustness against temperature-induced noise variations. ThRIve mitigates the effects of thermal-noise and prevent the drop in inference accuracy across the entire operating temperature range. Experimental results demonstrate that ThRIve-enabled architectures maintain consistent inference accuracy, with the mean accuracy staying within 2% of the ideal (i.e., noise-free) accuracy, and the variation in accuracy across the entire operating temperature range remaining within 2% of the mean. The proposed methodology achieves accuracy and robustness comparable to thermally-resilient Static Random-Access Memory (SRAM)-based PIM systems, while delivering up to 5.4x reduction in energy-delay product (EDP) during CNN model inferencing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。