arXiv:2508.20392cs.CVcs.AI2025-08

提出新型脉冲神经元模型,实现5步内高精度目标检测。

Ultra-Low-Latency Spiking Neural Networks with Temporal-Dependent Integrate-and-Fire Neuron Model for Objects Detection

  • 设计时序依赖的IF神经元,动态调整脉冲积累与发放行为。
  • 在5个时间步内完成检测,精度超越现有转换方法。
  • 适合低功耗、实时性要求高的边缘视觉任务。

脉冲神经网络(SNN)受大脑启发,具有极低功耗和快速推理能力,广泛应用于视觉感知任务。当前的ANN-SNN转换方法在分类任务中已实现超低时间步表现,但在目标检测任务上效果不佳。本文提出延迟脉冲机制,缓解异构脉冲模式导致的残余膜电位问题,并设计一种新型时序依赖的集成-放电(tdIF)神经元架构。该架构使IF神经元能根据时间步的先后顺序动态调整累积与放电行为,使脉冲具备独特的时序特性,而非仅依赖频率表征。tdIF神经元能耗与传统IF神经元相当。实验表明,该方法以更低的时间步数实现更精准的特征表示,在目标检测与车道线检测任务中均达到先进水平,且推理延迟极低(不超过5个时间步)。

原文摘要 · Abstract (English)

Spiking Neural Networks (SNNs), inspired by the brain, are characterized by minimal power consumption and swift inference capabilities on neuromorphic hardware, and have been widely applied to various visual perception tasks. Current ANN-SNN conversion methods have achieved excellent results in classification tasks with ultra-low time-steps, but their performance in visual detection tasks remains suboptimal. In this paper, we propose a delay-spike approach to mitigate the issue of residual membrane potential caused by heterogeneous spiking patterns. Furthermore, we propose a novel temporal-dependent Integrate-and-Fire (tdIF) neuron architecture for SNNs. This enables Integrate-and-fire (IF) neurons to dynamically adjust their accumulation and firing behaviors based on the temporal order of time-steps. Our method enables spikes to exhibit distinct temporal properties, rather than relying solely on frequency-based representations. Moreover, the tdIF neuron maintains energy consumption on par with traditional IF neuron. We demonstrate that our method achieves more precise feature representation with lower time-steps, enabling high performance and ultra-low latency in visual detection tasks. In this study, we conduct extensive evaluation of the tdIF method across two critical vision tasks: object detection and lane line detection. The results demonstrate that the proposed method surpasses current ANN-SNN conversion approaches, achieving state-of-the-art performance with ultra-low latency (within 5 time-steps).

脉冲神经网络目标检测低延迟神经形态计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。