arXiv:2603.06228cs.CV2026-03被引 5

提出稀疏空间线性注意力,实现事件相机低延迟目标检测新突破。

Low-Latency Event-Based Object Detection with Spatially-Sparse Linear Attention

论文配图:Low-Latency Event-Based Object Detection with Spatially-Sparse Linear Attention
图 1 · 摘自论文原文
  • 设计稀疏空间线性注意力,利用事件空间稀疏性降低计算开销。
  • 在Gen1和N-Caltech101上分别达到0.375和0.515 mAP,精度领先。
  • 每事件计算量减少20倍以上,适合实时嵌入式部署场景。

事件相机提供具有空间稀疏性和高时间分辨率的序列视觉数据,适用于低延迟目标检测。现有异步事件神经网络虽能逐事件更新预测,但存在两大瓶颈:循环结构难以高效训练长序列,且提升精度常导致单事件计算量与延迟上升。线性注意力因支持并行训练和循环推理而具吸引力,但其密集状态更新使单事件计算随状态规模增长,难以在需精细定位的检测任务中兼顾精度与效率。关键挑战在于引入空间稀疏状态激活,以利用事件的空间稀疏性,同时保持训练并行性。本文提出空间稀疏线性注意力(SSLA),通过空间混合状态分解与分散-计算-聚集训练流程,实现状态级稀疏与训练并行。基于SSLA构建端到端异步线性注意力模型SSLA-Det,用于低延迟事件相机目标检测。在Gen1与N-Caltech101数据集上,其性能优于现有异步方法,分别达到0.375 mAP与0.515 mAP,同时相较最强基线,单事件计算量降低超20倍,证明线性注意力在低延迟事件视觉中的潜力。

原文摘要 · Abstract (English)

Event cameras provide sequential visual data with spatial sparsity and high temporal resolution, making them attractive for low-latency object detection. Existing asynchronous event-based neural networks exploit this low-latency advantage by updating predictions event by event, but still suffer from two bottlenecks: recurrent architectures are difficult to train efficiently on long sequences, and improving accuracy often increases per-event computation and latency. Linear attention is appealing because it enables parallel training and recurrent inference. However, its dense state updates make per-event computation scale with the state size, yielding a poor accuracy-efficiency trade-off for object detection, where accurate localization requires fine-grained spatial states. The key challenge is therefore to introduce sparse state activation that exploits the spatial sparsity of events while preserving efficient parallel training. We propose Spatially-Sparse Linear Attention (SSLA), which introduces a mixture-of-spaces state decomposition and a scatter-compute-gather training procedure, enabling state-level sparsity as well as training parallelism. Building on SSLA, we develop an end-to-end asynchronous linear attention model, SSLA-Det, for low-latency event-based object detection. On Gen1 and N-Caltech101, SSLA-Det achieves state-of-the-art accuracy among asynchronous methods, reaching 0.375 mAP and 0.515 mAP, respectively, while reducing per-event computation by over 20 times compared with the strongest prior asynchronous baseline, demonstrating the potential of linear attention for low-latency event-based vision.

事件相机低延迟线性注意力目标检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。