arXiv:2501.15151cs.CV2025-01被引 4

通过优化神经元放电模式,提升脉冲网络目标检测精度与能效。

SpikeDet: Better Firing Patterns for Accurate and Energy-Efficient Object Detection with Spiking Neural Networks

  • 设计MDSNet调整膜电位分布,改善特征提取时的放电模式。
  • 在COCO上达52.2% AP,比之前SNN方法高3.3%,能耗减半。
  • 适用于事件相机、低光照等特殊场景,适合边缘计算部署。

脉冲神经网络(SNNs)作为第三代神经网络,因低功耗和生物可解释性,在目标检测领域受到广泛关注。然而,现有基于SNN的目标检测方法存在局部放电饱和问题,即相邻神经元在物体中心区域同时达到最大放电率,导致特征区分能力下降、检测精度降低,且高放电率阻碍了SNN能效潜力的发挥。为此,本文提出SpikeDet,一种新型脉冲目标检测器,通过优化放电模式实现高精度与低功耗。具体地,设计MDSNet作为脉冲骨干网络,有效调节每层的膜电位突触输入分布,提升特征提取阶段的放电质量;针对颈部结构,提出脉冲多方向融合模块(SMFM),实现脉冲特征的多方向融合,增强多尺度检测能力。此外,引入局部放电饱和指数(LFSI)对放电饱和程度进行量化评估。实验结果表明,SpikeDet在COCO 2017数据集上达到52.2% AP,较此前SNN方法提升3.3% AP,同时仅需一半能耗。在事件相机GEN1、水下URPC 2019、低光照ExDARK及密集场景CrowdHuman等子任务中也均取得最优性能。

原文摘要 · Abstract (English)

Spiking Neural Networks (SNNs) are the third generation of neural networks. They have gained widespread attention in object detection due to their low energy consumption and biological interpretability. However, existing SNN-based object detection methods suffer from local firing saturation, where adjacent neurons concurrently reach maximum firing rates, especially in object-centric regions. This abnormal neuron firing pattern reduces the feature discrimination capability and detection accuracy, while also increasing the firing rates that prevent SNNs from achieving their potential energy efficiency. To address this problem, we propose SpikeDet, a novel spiking object detector that optimizes firing patterns for accurate and energy-efficient detection. Specifically, we design a spiking backbone network, MDSNet, which effectively adjusts the membrane synaptic input distribution at each layer, achieving better neuron firing patterns during spiking feature extraction. For the neck, to better utilize and preserve these high-quality backbone features, we introduce the Spiking Multi-direction Fusion Module (SMFM), which realizes multi-direction fusion of spiking features, enhancing the multi-scale detection capability of the model. Furthermore, we propose the Local Firing Saturation Index (LFSI) to quantitatively measure local firing saturation. Experimental results validate the effectiveness of our method. On the COCO 2017 dataset, it achieves 52.2% AP, outperforming previous SNN-based methods by 3.3% AP while requiring only half the energy consumption. On object detection sub-tasks, including event-based GEN1, underwater URPC 2019, low-light ExDARK, and dense scene CrowdHuman datasets, SpikeDet also achieves the best performance.

脉冲神经网络目标检测能效优化事件相机

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。