arXiv:2605.25293cs.CVcs.AI2026-05

用脉冲神经网络实现低功耗车载激光雷达目标检测,兼顾精度与能效。

Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks

论文配图:Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks
图 1 · 摘自论文原文
  • 基于脉冲神经网络设计端到端鸟瞰图检测架构,支持事件驱动计算。
  • 最高达92.05%的检测准确率(KITTI Easy),比传统CNN节能3.33倍。
  • 可直接部署于类脑硬件,适合资源受限的自动驾驶系统。

自动驾驶感知需在严苛功耗约束下高效处理三维传感器数据。传统卷积神经网络虽精度高但计算密集,难以部署于资源受限的类脑平台。脉冲神经网络通过事件驱动的稀疏计算提供替代方案,但其在复杂感知任务中的应用仍有限。本文提出一种端到端脉冲编码-解码网络,用于激光雷达点云的鸟瞰图目标检测,采用代理梯度反向传播训练。设计两种变体:膜电位变体在输出阶段读取连续神经元状态,实现92.05/87.04/86.51的AP(IoU=0.5,Easy/Moderate/Hard);全二值脉冲变体全程仅使用脉冲信号,可直接部署于类脑硬件。评估四种输入脉冲编码策略,结果表明网络自学习脉冲表示优于手工设计的泊松、时序和高度编码,在无连续帧的KITTI基准上表现更优,通过重复呈现鸟瞰图模拟时间流。块级能效分析显示,相较等效卷积网络,突触操作能耗降低3.33倍。结果证明脉冲神经网络在自动驾驶中具备高精度与低功耗的可行性。

原文摘要 · Abstract (English)

Autonomous driving perception demands accurate and efficient processing of three-dimensional sensor data under strict power constraints. Traditional convolutional neural networks achieve strong detection accuracy but are computationally intensive, limiting their suitability for deployment on resource-constrained neuromorphic platforms. Spiking neural networks offer a compelling alternative through event-driven sparse computation, yet their application to complex real-world perception tasks such as three-dimensional object detection remains limited. In this work, we propose an end-to-end spiking encoder-decoder network for object detection in bird's eye view representations of LiDAR point clouds, trained using surrogate gradient backpropagation. We train two variants: a membrane potential variant that reads continuous neuron state at the output stage for maximum accuracy, achieving $92.05$/$87.04$/$86.51$ AP at $\mathrm{IoU}\!=\!0.5$ (Easy/Moderate/Hard), and, a fully binary spiking variant that operates exclusively on spike trains at every layer for direct neuromorphic deployment. We evaluate four input spike encoding strategies and demonstrate that allowing the network to learn spike representations directly from data outperforms hand-crafted Poisson, latency, and z-axis encoding schemes on the KITTI benchmark, where sequential frames are unavailable and the BEV input is presented repeatedly across timesteps as a proxy for temporal streaming. A block-wise energy analysis demonstrates a $3.33\times$ reduction in synaptic operation energy over an equivalent CNN under conservative loop-based operation. Together, these results demonstrate the viability of spiking neural networks for accurate and energy-efficient neuromorphic perception in autonomous driving.

类脑计算激光雷达目标检测脉冲神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。