arXiv:2502.16907cs.CVcs.AI2025-02被引 8

用Mamba结构提升点云场景光流估计精度与速度

MambaFlow: A Novel and Flow-guided State Space Model for Scene Flow Estimation

  • 基于Mamba的解码器实现时空特征深度耦合
  • 在Argoverse 2上达到领先性能,支持实时推理
  • 自适应损失函数提升复杂场景泛化能力

场景光流估计旨在从连续点云帧中预测3D运动,对自动驾驶具有重要意义。现有方法面临时空建模不足及体素化过程丢失细粒度特征的问题。Mamba作为状态空间模型(SSM)代表,以线性复杂度实现全局建模,为解决该问题提供新思路。本文提出MambaFlow,一种基于Mamba的解码器结构,通过精心设计的主干网络实现时空特征深度交互与耦合。创新地,利用点偏移信息引导体素特征的全局注意力建模,学习体素到点的映射模式,将共享体素表示还原为点级特征。为进一步提升模型在多样场景下的泛化能力,提出一种新型场景自适应损失函数,可自动适配不同运动模式。在Argoverse 2基准上的大量实验表明,MambaFlow在现有方法中达到最优性能,同时实现实时推理速度,适用于真实城市场景中的高精度光流估计。代码已开源:https://github.com/SCNU-RISLAB/MambaFlow。

原文摘要 · Abstract (English)

Scene flow estimation aims to predict 3D motion from consecutive point cloud frames, which is of great interest in autonomous driving field. Existing methods face challenges such as insufficient spatio-temporal modeling and inherent loss of fine-grained feature during voxelization. However, the success of Mamba, a representative state space model (SSM) that enables global modeling with linear complexity, provides a promising solution. In this paper, we propose MambaFlow, a novel scene flow estimation network with a mamba-based decoder. It enables deep interaction and coupling of spatio-temporal features using a well-designed backbone. Innovatively, we steer the global attention modeling of voxel-based features with point offset information using an efficient Mamba-based decoder, learning voxel-to-point patterns that are used to devoxelize shared voxel representations into point-wise features. To further enhance the model's generalization capabilities across diverse scenarios, we propose a novel scene-adaptive loss function that automatically adapts to different motion patterns.Extensive experiments on the Argoverse 2 benchmark demonstrate that MambaFlow achieves state-of-the-art performance with real-time inference speed among existing works, enabling accurate flow estimation in real-world urban scenarios. The code is available at https://github.com/SCNU-RISLAB/MambaFlow.

场景光流Mamba点云处理自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。