WinMamba通过可变窗口提升3D目标检测效率与精度
WinMamba: Multi-Scale Shifted Windows in State Space Model for 3D Object Detection
- 引入自适应窗口采样和位移策略增强上下文建模
- 在KITTI和Waymo上实现显著更高的检测精度
- 适合追求高效3D感知的自动驾驶研究者
3D目标检测对自动驾驶至关重要,但如何在保持计算效率的同时捕捉长程空间依赖仍具挑战。我们发现基于Mamba的模型凭借线性状态空间设计,在较低成本下即可有效捕捉长程依赖,实现了效率与精度的平衡。然而现有方法依赖固定窗口的轴对齐扫描,不可避免地丢失空间信息。为此,我们提出WinMamba,一种由堆叠的WinMamba模块组成的新型Mamba基3D特征编码主干。为增强多尺度表征能力,WinMamba模块引入窗口尺度自适应模块,在采样过程中补偿不同分辨率下的体素特征。同时,为在状态空间中获取丰富上下文线索,我们为WinMamba层加入可学习位置编码和窗口位移策略。在KITTI和Waymo数据集上的大量实验表明,WinMamba显著优于基线模型。消融实验证实了WSF和AWF模块对提升检测精度的独立贡献。代码将公开。
原文摘要 · Abstract (English)
3D object detection is critical for autonomous driving, yet it remains fundamentally challenging to simultaneously maximize computational efficiency and capture long-range spatial dependencies. We observed that Mamba-based models, with their linear state-space design, capture long-range dependencies at lower cost, offering a promising balance between efficiency and accuracy. However, existing methods rely on axis-aligned scanning within a fixed window, inevitably discarding spatial information. To address this problem, we propose WinMamba, a novel Mamba-based 3D feature-encoding backbone composed of stacked WinMamba blocks. To enhance the backbone with robust multi-scale representation, the WinMamba block incorporates a window-scale-adaptive module that compensates voxel features across varying resolutions during sampling. Meanwhile, to obtain rich contextual cues within the linear state space, we equip the WinMamba layer with a learnable positional encoding and a window-shift strategy. Extensive experiments on the KITTI and Waymo datasets demonstrate that WinMamba significantly outperforms the baseline. Ablation studies further validate the individual contributions of the WSF and AWF modules in improving detection accuracy. The code will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。