arXiv:2412.17366cs.CV2024-12AAAI被引 6

提出FlowMamba,用全局运动传播提升点云场景流估计精度

FlowMamba: Learning Point Cloud Scene Flow with Global Motion Propagation

  • 设计基于状态空间模型的迭代单元,融合全局运动与局部状态
  • 在FlyingThings3D和KITTI上分别降低21.9%和20.5%的三维误差
  • 首次实现飞物数据集和KITTI的毫米级预测,可嵌入现有网络

基于深度学习的场景流方法已取得显著进展,但当前先进方法在平坦区域或遮挡等病态区域仍表现不佳,主要因局部证据不足。本文提出一种具有全局运动传播能力的新网络FlowMamba。其核心是基于状态空间模型的迭代单元(ISU),先传播全局运动模式,再自适应融合全局信息与先前隐藏状态。由于点云不规则性限制了ISU在全局传播中的性能,我们引入特征诱导排序策略(FIO),利用语义相关和运动相关特征将点有序排列,以保持空间连续性。大量实验表明,FlowMamba在FlyingThings3D和KITTI数据集上分别比最优已有结果降低21.9%和20.5%的3D端点误差(EPE3D)。特别地,该方法首次在FlyingThings3D和KITTI上实现毫米级预测精度。此外,所提ISU可作为即插即用模块嵌入现有迭代网络,显著提升估计精度。

原文摘要 · Abstract (English)

Scene flow methods based on deep learning have achieved impressive performance. However, current top-performing methods still struggle with ill-posed regions, such as extensive flat regions or occlusions, due to insufficient local evidence. In this paper, we propose a novel global-aware scene flow estimation network with global motion propagation, named FlowMamba. The core idea of FlowMamba is a novel Iterative Unit based on the State Space Model (ISU), which first propagates global motion patterns and then adaptively integrates the global motion information with previously hidden states. As the irregular nature of point clouds limits the performance of ISU in global motion propagation, we propose a feature-induced ordering strategy (FIO). The FIO leverages semantic-related and motion-related features to order points into a sequence characterized by spatial continuity. Extensive experiments demonstrate the effectiveness of FlowMamba, with 21.9\% and 20.5\% EPE3D reduction from the best published results on FlyingThings3D and KITTI datasets. Specifically, our FlowMamba is the first method to achieve millimeter-level prediction accuracy in FlyingThings3D and KITTI. Furthermore, the proposed ISU can be seamlessly embedded into existing iterative networks as a plug-and-play module, improving their estimation accuracy significantly.

点云场景流运动估计Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。