用Mamba模型压缩3D目标检测,轻量高效适合车载部署。
Lightweight 3D Object Detection via Mamba-Based Knowledge Distillation

- 用Mamba构建教师网络,通过选择性特征对齐传递体素知识。
- 在公开数据集和真实数据上,计算量降低同时精度保持领先。
- 适合资源受限的自动驾驶与机器人实时感知场景。
基于激光雷达(LiDAR)的3D目标检测需在精度与计算效率间取得平衡,以支持自动驾驶和机器人导航中的车载感知。现有方法多采用复杂架构提取丰富上下文信息以提升精度,但带来高昂计算开销,难以在资源受限的嵌入式设备上运行。本文提出一种基于Mamba的知识蒸馏框架,通过选择性体素空间特征对齐,将强教师模型中的对象级体素表示迁移至轻量学生模型。利用具有选择性状态空间的线性时间序列模型Mamba,设计多分支Mamba教师主干,并引入盒感知特征传输机制,通过Mamba投影模块对齐师生网络间的空间对应体素特征。在公开数据集及真实世界数据上的实验表明,该方法显著降低计算负载,同时保持与当前最优方法相当的检测精度。
原文摘要 · Abstract (English)
3D object detection using light detection and ranging (LiDAR) sensors requires a balance between accuracy and computational efficiency for onboard perception in autonomous driving and robotic navigation. Many existing LiDAR-based detection methods employ complex architectures to extract features, integrating large amounts of contextual information to enhance accuracy. This often results in significant computational costs, leading to suboptimal performance on resource-constrained embedded devices. In this study, we propose a knowledge distillation framework that transfers object-level voxel representations from a strong teacher model to lightweight student models through selective voxel-space feature alignment. Taking advantage of the linear-time sequence model with selective state spaces (Mamba), we design a multi-branch Mamba teacher backbone and a box-aware feature transfer mechanism that aligns spatially corresponding voxel features between teacher and student networks through a Mamba-based projection module. Experimental results on both a public dataset and real-world data show that our approach significantly reduces computational load while maintaining competitive accuracy compared with state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。