arXiv:2607.26703cs.CV2026-07

让脉冲神经网络持续处理事件流,提升目标检测精度。

Sequence-SOD: Bio-inspired Sequence-aware Spiking ObjectDetection for Event Cameras

  • 用连续事件序列替代单间隔输入,保持神经膜电位延续
  • 在汽车数据集上mAP从23.38提升至26.88,理论预测频率达40Hz
  • 适合做低功耗、高实时性事件相机目标检测系统

事件相机遵循类视网膜感知原理,以高时间分辨率和宽动态范围异步报告局部亮度变化。脉冲神经网络(SNN)通过类脑动态机制,利用稀疏脉冲和漏电膜电位对时间信息进行整合。然而,现有SNN目标检测器通常处理孤立事件片段并每次预测后重置状态,导致连续事件流中的时序信息被浪费。本文提出Sequence-SOD,一种序列感知的SNN目标检测器,可处理包含多个时间点标签的长事件序列。事件被累积为短时间段,离散化为时间步,并按序输入基于SSD架构的脉冲密集网络,同时在序列内保持膜电位延续,使检测由不断演化的神经状态驱动,而非独立重置的输入窗口。在Gen1汽车检测数据集上,序列感知训练将mAP从单间隔训练的23.38提升至无增强时的25.30,增强后达26.88。模型理论预测频率为40 Hz。结果表明,在扩展事件序列上训练可有效利用时序线索,同时保留稀疏脉冲计算的能效优势。序列感知训练是事件基SNN检测的互补方向,与架构改进并行。

原文摘要 · Abstract (English)

Event cameras follow a retina-inspired sensing principle, reporting local intensity changes asynchronously with hightemporal resolution and a wide dynamic range. Spiking Neural Networks (SNNs) complement these sparse event streams through brain-inspired dynamics, using sparse spikes and leaky membrane potentials to integrate information over time. However, many SNN object detectors process isolated event intervals with a single label and reset the network state after each prediction, thereby underusing temporal information in continuous event streams. We introduce Sequence-SOD, a sequence-aware SNN object detector that processes extended event sequences containing labels at multiple time points. Events are accumulated into short intervals, discretized into temporal steps, and fed sequentially to an SSD-style Spiking DenseNet while preserving membrane potentials across intervals within a sequence, so that detection is driven by an evolving neural state instead of independently reset input windows. On the Gen1 Automotive Detection Dataset, sequence-aware training improves mAP from 23.38 for single-interval training to 25.30 without augmentation and to 26.88 withevent-data augmentation. The model achieves a theoretical prediction frequency of 40 Hz. Training and evaluating SNN object detectors on extended event sequences improves their ability to exploit temporal cues while preserving the energy-efficiency benefits of sparse spiking computation. The results highlight sequence-aware training as a complementary direction to architectural improvements for event-based SNN detection.

事件相机脉冲神经网络目标检测时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。