提出稀疏场景流方法,解决远距离自动驾驶中运动估计难题
SSF: Sparse Long-Range Scene Flow for Autonomous Driving
- 用稀疏卷积替代密集特征图,降低远距离计算开销
- 在Argoverse2上达到最新最佳性能,远距离点精度显著提升
- 适合需要高效长距感知的自动驾驶系统研发者
场景流能理解三维环境中物体的运动特性,在远距离尤其重要,因稀疏观测下基于目标的感知方法易失效。尽管场景流处理大尺度点云已取得进展,但远距离扩展性仍受限,根源在于常用密集特征网格随距离呈二次增长。本文提出稀疏场景流(SSF)通用框架,采用基于稀疏卷积的骨干网络进行特征提取。该方法带来新挑战:时序点云间稀疏特征图存在尺寸与顺序不匹配。为此,提出稀疏特征融合方案,通过在缺失位置插入虚拟体素来补全特征图。此外,设计一种按距离加权的度量方式,隐式提升远距离点的重要性。在Argoverse2数据集上,SSF实现当前最优表现,证明其在远距离场景流估计中的强大能力。代码将开源。
原文摘要 · Abstract (English)
Scene flow enables an understanding of the motion characteristics of the environment in the 3D world. It gains particular significance in the long-range, where object-based perception methods might fail due to sparse observations far away. Although significant advancements have been made in scene flow pipelines to handle large-scale point clouds, a gap remains in scalability with respect to long-range. We attribute this limitation to the common design choice of using dense feature grids, which scale quadratically with range. In this paper, we propose Sparse Scene Flow (SSF), a general pipeline for long-range scene flow, adopting a sparse convolution based backbone for feature extraction. This approach introduces a new challenge: a mismatch in size and ordering of sparse feature maps between time-sequential point scans. To address this, we propose a sparse feature fusion scheme, that augments the feature maps with virtual voxels at missing locations. Additionally, we propose a range-wise metric that implicitly gives greater importance to faraway points. Our method, SSF, achieves state-of-the-art results on the Argoverse2 dataset, demonstrating strong performance in long-range scene flow estimation. Our code will be released at https://github.com/KTH-RPL/SSF.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。