用动态生成权重和压缩技术,让边缘设备运行深度学习模型更省内存、更安全。
Secure and Storage-Efficient Deep Learning Models for Edge AI Using Automatic Weight Generation
- 通过PCA与轻量回归模型动态生成全连接层权重,无需存储完整参数矩阵。
- 在低敏感度卷积层使用压缩,实现53倍(全连接)和18倍(AlexNet)内存压缩。
- 压缩层对错误更敏感,可有效检测比特翻转攻击,适合资源受限的边缘场景。
复杂神经网络需要大量内存存储突触权重。本文提出WINGs框架,通过在全连接网络中动态生成层权重,并在推理阶段压缩卷积网络权重,显著降低内存需求而不损失精度。该框架采用主成分分析(PCA)进行降维,结合轻量支持向量回归(SVR)预测全连接层权重,避免存储完整权重矩阵;同时基于敏感性分析,优先压缩卷积网络中低敏感度层的权重。敏感性感知设计提升了安全性:压缩层中的任何比特翻转攻击都会导致准确率显著下降,易于检测。在MNIST上对全连接层实现53倍压缩,在AlexNet上实现28倍压缩;在CIFAR-10上对AlexNet实现18倍压缩,仅损失1-2%精度。内存大幅减少带来更高吞吐量与更低能耗,适用于资源受限的边缘计算场景。
原文摘要 · Abstract (English)
Complex neural networks require substantial memory to store a large number of synaptic weights. This work introduces WINGs (Automatic Weight Generator for Secure and Storage-Efficient Deep Learning Models), a novel framework that dynamically generates layer weights in a fully connected neural network (FC) and compresses the weights in convolutional neural networks (CNNs) during inference, significantly reducing memory requirements without sacrificing accuracy. WINGs framework uses principal component analysis (PCA) for dimensionality reduction and lightweight support vector regression (SVR) models to predict layer weights in the FC networks, removing the need for storing full-weight matrices and achieving substantial memory savings. It also preferentially compresses the weights in low-sensitivity layers of CNNs using PCA and SVR with sensitivity analysis. The sensitivity-aware design also offers an added level of security, as any bit-flip attack with weights in compressed layers has an amplified and readily detectable effect on accuracy. WINGs achieves 53x compression for the FC layers and 28x for AlexNet with MNIST dataset, and 18x for Alexnet with CIFAR-10 dataset with 1-2% accuracy loss. This significant reduction in memory results in higher throughput and lower energy for DNN inference, making it attractive for resource-constrained edge applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。