arXiv:2602.19536cs.CVcs.AI2026-02

改进3D检测的Mamba模型,聚焦前景增强提升精度

Fore-Mamba3D: Mamba-based Foreground-Enhanced Encoding for 3D Object Detection

  • 仅对预测得分高的前景体素进行编码,减少背景干扰
  • 引入滑动窗口机制缓解前景间信息衰减,提升上下文建模能力
  • 适合追求高精度3D目标检测的工业级应用与自动驾驶场景

基于线性建模的Mamba方法已被广泛用于3D物体检测任务。然而,现有Mamba方法对所有非空体素序列采用双向编码,其中包含大量无用背景信息。尽管直接编码前景体素看似合理,但常导致检测性能下降。我们归因于线性建模中前景序列跨实例交互时的响应衰减及上下文表示受限。为此,提出新型骨干网络Fore-Mamba3D,通过修改基于Mamba的编码器实现前景增强。首先根据预测分数采样前景体素;为缓解前景体素间跨实例信息衰减,设计区域到全局滑动窗口(RGSW)以传播区域信息至全序列;进一步提出语义辅助状态空间融合模块(SASFMamba),在Mamba模型中增强语义与几何感知以丰富上下文表征。该方法强调前景专用编码,缓解线性自回归模型中的距离依赖与因果依赖问题。在多个基准测试上表现优异,验证了Fore-Mamba3D在3D物体检测任务中的有效性。

原文摘要 · Abstract (English)

Linear modeling methods like Mamba have been merged as the effective backbone for the 3D object detection task. However, previous Mamba-based methods utilize the bidirectional encoding for the whole non-empty voxel sequence, which contains abundant useless background information in the scenes. Though directly encoding foreground voxels appears to be a plausible solution, it tends to degrade detection performance. We attribute this to the response attenuation and restricted context representation in the linear modeling for fore-only sequences. To address this problem, we propose a novel backbone, termed Fore-Mamba3D, to focus on the foreground enhancement by modifying Mamba-based encoder. The foreground voxels are first sampled according to the predicted scores. Considering the response attenuation existing in the interaction of foreground voxels across different instances, we design a regional-to-global slide window (RGSW) to propagate the information from regional split to the entire sequence. Furthermore, a semantic-assisted and state spatial fusion module (SASFMamba) is proposed to enrich contextual representation by enhancing semantic and geometric awareness within the Mamba model. Our method emphasizes foreground-only encoding and alleviates the distance-based and causal dependencies in the linear autoregression model. The superior performance across various benchmarks demonstrates the effectiveness of Fore-Mamba3D in the 3D object detection task.

3D检测Mamba前景增强线性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。