arXiv:2509.19156cs.CV2025-09ICML

通过脉冲压缩与动态提前退出,实现边缘云协同的高效低耗神经网络推理。

NeuCODEX: Edge-Cloud Co-Inference with Spike-Driven Compression and Dynamic Early-Exit

  • 用学习型脉冲压缩减少传输数据,结合动态提前退出适应输出置信度。
  • 数据传输降低2048倍,边缘能耗降超90%,端到端延迟减少3倍,精度损失<2%。
  • 适合资源受限场景的高能效脉冲神经网络部署,尤其适用于实时视觉任务。

脉冲神经网络(SNNs)在边缘端实现节能智能方面具有巨大潜力。然而,由于固定且较高的时间步开销,全量SNN推理在边缘端面临延迟与能耗挑战。边缘-云协同推理系统虽具前景,但常受高延迟和特征传输成本制约。为此,我们提出NeuCODEX,一种联合优化时空冗余的类脑协同推理架构。NeuCODEX引入可学习的脉冲驱动压缩模块以降低数据传输,并采用动态提前退出机制根据输出置信度自适应终止推理。我们在静态图像(CIFAR10、Caltech)和类脑事件流(CIFAR10-DVS、N-Caltech)上评估了该系统。为验证实用性,我们在真实边缘-云测试平台中对ResNet-18和VGG-16主干网络进行了原型实现。结果表明,与纯边缘推理相比,NeuCODEX将数据传输减少高达2048倍,边缘能耗降低超过90%,端到端延迟减少3倍,且精度下降不足2%。该系统使资源受限环境下的高性能SNN部署成为可能。

原文摘要 · Abstract (English)

Spiking Neural Networks (SNNs) offer significant potential for enabling energy-efficient intelligence at the edge. However, performing full SNN inference at the edge can be challenging due to the latency and energy constraints arising from fixed and high timestep overheads. Edge-cloud co-inference systems present a promising solution, but their deployment is often hindered by high latency and feature transmission costs. To address these issues, we introduce NeuCODEX, a neuromorphic co-inference architecture that jointly optimizes both spatial and temporal redundancy. NeuCODEX incorporates a learned spike-driven compression module to reduce data transmission and employs a dynamic early-exit mechanism to adaptively terminate inference based on output confidence. We evaluated NeuCODEX on both static images (CIFAR10 and Caltech) and neuromorphic event streams (CIFAR10-DVS and N-Caltech). To demonstrate practicality, we prototyped NeuCODEX on ResNet-18 and VGG-16 backbones in a real edge-to-cloud testbed. Our proposed system reduces data transfer by up to 2048x and edge energy consumption by over 90%, while reducing end-to-end latency by up to 3x compared to edge-only inference, all with a negligible accuracy drop of less than 2%. In doing so, NeuCODEX enables practical, high-performance SNN deployment in resource-constrained environments.

脉冲神经网络边缘计算协同推理节能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。