用脉冲神经网络压缩边缘计算特征,传输量降256倍且省电144倍。
SpikeBottleNet: Spike-Driven Feature Compression Architecture for Edge-Cloud Co-Inference
- 将脉冲神经网络融入边缘-云协同推理,用事件驱动激活降低能耗。
- ResNet最后一层特征压缩达256倍,精度仅损失0.16%。
- 适合低功耗、带宽受限的边缘设备部署。
边缘-云协同推理通过在边缘设备与云端服务器间分割深度神经网络架构,实现高效部署,对资源受限的边缘设备至关重要。该方法需平衡本地计算与通信开销,通常通过压缩中间特征传输来实现。传统DNN需持续数据处理和浮点激活,导致高能耗与大特征尺寸,增加传输成本。为此,本文探索使用脉冲神经网络(SNN)的二值化、事件驱动激活,因其具备极低能耗优势。我们提出SpikeBottleNet,一种面向边缘-云协同推理的新架构,引入脉冲神经元模型显著降低边缘设备能耗。研究关键创新在于为SNN设计的中间特征压缩技术,采用分治计算策略,将编码器-解码器瓶颈单元嵌入ResNet、MobileNet等复杂结构中。实验表明,SpikeBottleNet在ResNet最后一层实现最高256倍比特压缩,精度损失仅0.16%;相比基线BottleNet,边缘设备能效提升高达144倍,适用于资源受限场景。
原文摘要 · Abstract (English)
Edge-cloud co-inference enables efficient deep neural network (DNN) deployment by splitting the architecture between an edge device and cloud server, crucial for resource-constraint edge devices. This approach requires balancing on-device computations and communication costs, often achieved through compressed intermediate feature transmission. Conventional DNN architectures require continuous data processing and floating point activations, leading to considerable energy consumption and increased feature sizes, thus raising transmission costs. This challenge motivates exploring binary, event-driven activations using spiking neural networks (SNNs), known for their extreme energy efficiency. In this research, we propose SpikeBottleNet, a novel architecture for edge-cloud co-inference systems that integrates a spiking neuron model to significantly reduce energy consumption on edge devices. A key innovation of our study is an intermediate feature compression technique tailored for SNNs for efficient feature transmission. This technique leverages a split computing approach to strategically place encoder-decoder bottleneck units within complex deep architectures like ResNet and MobileNet. Experimental results demonstrate that SpikeBottleNet achieves up to 256x bit compression in the final convolutional layer of ResNet, with minimal accuracy loss (0.16%). Additionally, our approach enhances edge device energy efficiency by up to 144x compared to the baseline BottleNet, making it ideal for resource-limited edge devices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。