arXiv:2503.12009cs.CV2025-03CVPR被引 23

用Mamba模型统一建模3D点云的局部与全局关系,提升激光雷达目标检测精度。

UniMamba: Unified Spatial-Channel Representation Learning with Group-Efficient Mamba for LiDAR-based 3D Object Detection

  • 设计UniMamba块,融合3D卷积与状态空间模型,兼顾局部与全局上下文。
  • 在nuScenes上达到70.2 mAP,显著优于传统Transformer方法。
  • 适合关注高效3D感知、点云处理的算法研究者与工程师。

近年来,基于Transformer的激光雷达3D目标检测框架通过将3D体素序列化为一维序列,有效捕捉点云空间的全局依赖,但序列化过程会破坏3D体素的空间结构。同时,由于3D体素数量庞大且Transformer具有二次复杂度,需对多个序列分组处理,导致感受野受限。受二维视觉任务中状态空间模型(SSM)优异表现的启发,本文提出一种新型统一型Mamba(UniMamba),以简洁的多头方式融合3D卷积与SSM优势,实现局部与全局空间上下文的高效同步聚合。具体而言,设计了包含空间局部性建模、互补Z阶曲线序列化及局部-全局序列聚合器的UniMamba模块。其中,3D子流形卷积用于序列化前动态建模空间位置嵌入;采用高效的Z阶曲线进行水平与垂直方向序列化;局部-全局序列聚合器则通过通道分组策略,利用多头SSM编码“局部与全局”空间相互依赖。此外,构建堆叠UniMamba块的编码器-解码器架构,实现多层次的空间学习。在nuScenes、Waymo和Argoverse 2三个主流数据集上进行了大量实验,结果表明,所提方法在nuScenes上达到70.2 mAP。

原文摘要 · Abstract (English)

Recent advances in LiDAR 3D detection have demonstrated the effectiveness of Transformer-based frameworks in capturing the global dependencies from point cloud spaces, which serialize the 3D voxels into the flattened 1D sequence for iterative self-attention. However, the spatial structure of 3D voxels will be inevitably destroyed during the serialization process. Besides, due to the considerable number of 3D voxels and quadratic complexity of Transformers, multiple sequences are grouped before feeding to Transformers, leading to a limited receptive field. Inspired by the impressive performance of State Space Models (SSM) achieved in the field of 2D vision tasks, in this paper, we propose a novel Unified Mamba (UniMamba), which seamlessly integrates the merits of 3D convolution and SSM in a concise multi-head manner, aiming to perform "local and global" spatial context aggregation efficiently and simultaneously. Specifically, a UniMamba block is designed which mainly consists of spatial locality modeling, complementary Z-order serialization and local-global sequential aggregator. The spatial locality modeling module integrates 3D submanifold convolution to capture the dynamic spatial position embedding before serialization. Then the efficient Z-order curve is adopted for serialization both horizontally and vertically. Furthermore, the local-global sequential aggregator adopts the channel grouping strategy to efficiently encode both "local and global" spatial inter-dependencies using multi-head SSM. Additionally, an encoder-decoder architecture with stacked UniMamba blocks is formed to facilitate multi-scale spatial learning hierarchically. Extensive experiments are conducted on three popular datasets: nuScenes, Waymo and Argoverse 2. Particularly, our UniMamba achieves 70.2 mAP on the nuScenes dataset.

3D检测Mamba点云处理激光雷达

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。