让普通类脑芯片高效运行脉冲神经网络,支持边端实时学习。
Enabling Efficient Processing of Spiking Neural Networks with On-Chip Learning on Commodity Neuromorphic Processors for Edge AI Systems
- 针对芯片资源设计适配的脉冲网络与映射策略
- 图像分类延迟<50ms,关键词识别<1ms,功耗<250mW
- 支持边端设备动态学习新类别,适合机器人等场景
随着对节能型边端AI系统(如移动机器人)需求的增长,脉冲神经网络(SNN)在类脑处理器上的应用受到关注,因其能实现超低功耗计算。然而,其高效部署策略尚未充分研究,制约了在边端的应用。为此,本文提出一种面向通用类脑芯片的SNN高效处理方法:首先分析目标硬件的内存与计算资源限制,进行网络兼容性评估;随后采用优化映射策略实现SNN高效部署;并引入高效的片上学习机制,使系统可适应新输入类别和动态环境。实验表明,该方法在图像分类中推理延迟低于50ms,视频流实时目标检测低于200ms,关键词识别低于1ms;片上学习延迟低于2ms;整体功耗低于250mW,能耗低于15mJ。结果验证了该方法在多样化应用场景中实现高效边端AI的潜力。
原文摘要 · Abstract (English)
The rising demand for energy-efficient edge AI systems (e.g., mobile agents/robots) has increased the interest in neuromorphic computing, since it offers ultra-low power/energy AI computation through spiking neural network (SNN) algorithms on neuromorphic processors. However, their efficient implementation strategy has not been comprehensively studied, hence limiting SNN deployments for edge AI systems. Toward this, we propose a design methodology to enable efficient SNN processing on commodity neuromorphic processors. To do this, we first study the key characteristics of targeted neuromorphic hardware (e.g., memory and compute budgets), and leverage this information to perform compatibility analysis for network selection. Afterward, we employ a mapping strategy for efficient SNN implementation on the targeted processor. Furthermore, we incorporate an efficient on-chip learning mechanism to update the systems' knowledge for adapting to new input classes and dynamic environments. The experimental results show that the proposed methodology leads the system to achieve low latency of inference (i.e., less than 50ms for image classification, less than 200ms for real-time object detection in video streaming, and less than 1ms in keyword recognition) and low latency of on-chip learning (i.e., less than 2ms for keyword recognition), while incurring less than 250mW of processing power and less than 15mJ of energy consumption across the respective different applications and scenarios. These results show the potential of the proposed methodology in enabling efficient edge AI systems for diverse application use-cases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。