用脉冲神经网络在边缘硬件上实现低功耗实时目标检测。
Real-Time Frame- and Event-based Object Detection with Spiking Neural Networks on Edge Neuromorphic Hardware: Design, Deployment and Benchmark

- 设计通用脉冲神经网络架构并适配英特尔Loihi 2芯片部署。
- Loihi 2平台每推理能耗最低,且支持实时检测。
- 蒸馏训练使脉冲网络精度恢复至原人工网络的87%-100%。
在能耗受限平台实现实时目标检测对无人机巡检、自主导航和移动机器人等应用至关重要。脉冲神经网络(SNNs)在类脑硬件上被认为比传统人工神经网络(ANNs)能效更高。本文提出一套面向类脑平台的通用SNN检测架构设计方法,并完成在最新类脑处理器英特尔Loihi 2上的工程化部署。我们在Loihi 2上使用帧基与事件基数据集对SNN检测进行基准测试,对比了在NVIDIA Jetson Orin Nano、Jetson Nano B01和Apple M2 CPU上的ANN检测性能。结果表明,Loihi 2上的SNN可在实现实时检测的同时,达到所有平台中最低的每推理动态能耗。尽管Jetson Orin Nano上的ANN具有更高推理速率,但Loihi 2在功耗方面表现更优。此外,采用感知蒸馏的训练方式使SNN恢复其对应ANN 87%-100%的检测精度,而无蒸馏时精度下降11%-27%。这些结果凸显了类脑系统在边缘实现高能效实时目标检测的潜力。
原文摘要 · Abstract (English)
Real-time object detection on energy-constrained platforms is critical for applications such as UAV-based inspection, autonomous navigation, and mobile robotics. Spiking neural networks (SNNs) on neuromorphic hardware are believed to be significantly more energy-efficient than conventional artificial neural networks (ANNs). In this work, we present a comprehensive methodology for designing general SNN detection architectures targeting neuromorphic platforms, along with the engineering adaptations required to deploy them on the state-of-the-art Neuromorphic processor, Intel Loihi 2. We benchmark SNN-based object detection on Loihi 2 using both frame-based and event-based datasets, comparing performance with ANN-based detection on the NVIDIA Jetson Orin Nano, NVIDIA Jetson Nano B01, and the Apple M2 CPU. Our results show that SNNs on Loihi 2 can perform real-time detection while achieving the lowest per-inference dynamic energy among all platforms. Also, Loihi 2 outperforms the other platforms in terms of power consumption, though ANNs on Jetson Orin Nano achieve higher inference rates. Furthermore, our ANN-to-SNN distillation-aware training enables SNNs to recover 87-100% of the detection accuracy of their ANN counterparts while maintaining lower inference latency; without distillation, SNNs exhibit an 11-27% accuracy drop. These results highlight the potential of neuromorphic systems for energy-efficient, real-time object detection at the edge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。