用自适应稀疏化提升事件相机目标检测的效率与精度
SMamba: Sparse Mamba for Event-based Object Detection
- 通过时空连续性评估动态筛选低信息量事件,减少冗余计算
- 在三个数据集上实现更高检测精度且计算量更低
- 适合需要高效实时事件感知的机器人与自动驾驶场景
基于Transformer的方法在事件相机目标检测中表现优异,得益于其全局建模能力。然而,它们对非事件和噪声区域同样处理,导致计算开销大。现有窗口注意力稀疏策略虽降低开销,但牺牲了全局建模能力,影响性能。为此,本文提出Sparse Mamba(SMamba),在保持全局建模能力的同时实现自适应稀疏化。首先设计时空连续性评估模块,利用活动与噪声事件在时空分布上的差异,识别并剔除低信息量令牌;随后提出信息优先局部扫描策略,缩短高信息令牌间的扫描距离,增强空间交互;此外,引入全局通道交互模块,将全局空间视角下的通道信息聚合,拓展全局交互至三维表示。在Gen1、1Mpx和eTram三个数据集上的实验表明,本方法在准确率与效率之间取得更好平衡,优于现有方法。
原文摘要 · Abstract (English)
Transformer-based methods have achieved remarkable performance in event-based object detection, owing to the global modeling ability. However, they neglect the influence of non-event and noisy regions and process them uniformly, leading to high computational overhead. To mitigate computation cost, some researchers propose window attention based sparsification strategies to discard unimportant regions, which sacrifices the global modeling ability and results in suboptimal performance. To achieve better trade-off between accuracy and efficiency, we propose Sparse Mamba (SMamba), which performs adaptive sparsification to reduce computational effort while maintaining global modeling capability. Specifically, a Spatio-Temporal Continuity Assessment module is proposed to measure the information content of tokens and discard uninformative ones by leveraging the spatiotemporal distribution differences between activity and noise events. Based on the assessment results, an Information-Prioritized Local Scan strategy is designed to shorten the scan distance between high-information tokens, facilitating interactions among them in the spatial dimension. Furthermore, to extend the global interaction from 2D space to 3D representations, a Global Channel Interaction module is proposed to aggregate channel information from a global spatial perspective. Results on three datasets (Gen1, 1Mpx, and eTram) demonstrate that our model outperforms other methods in both performance and efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。