arXiv:2409.14985cs.CVcs.AI2024-09被引 1

用图像特征生成更精准的3D点云,提升远距离小物体检测

Image-Guided Semantic Pseudo-LiDAR Point Generation for 3D Object Detection

  • 利用图像语义信息生成稠密且有意义的伪点云
  • 在KITTI上使行人检测mAP提升7.91个百分点,误报率降近50%
  • 适合需要高精度3D目标检测的自动驾驶系统

在自动驾驶场景中,精准感知对安全导航至关重要。虽然激光雷达提供精确空间数据,但其固有的稀疏性使其难以检测小或远距离物体。现有方法尝试在感兴趣区域(RoI)内生成额外点,但仅依赖激光雷达常导致误报且无法恢复有效结构。为此,我们提出图像引导语义伪激光雷达点生成模型ImagePG,首次直接利用丰富的RGB图像特征生成稠密且语义明确的3D点。该框架包含图像引导的RoI点生成模块(IG-RPG),基于图像特征生成伪点;图像感知占据预测网络(I-OPN),提供空间先验指导点位置;以及多阶段精炼模块(MR),进一步提升点质量与检测鲁棒性。在KITTI和Waymo数据集上的大量实验表明,ImagePG显著提升对行人、自行车等小而远物体的检测性能,误报率降低近50%。在KITTI基准测试中,相比基线模型,汽车检测mAP提升+1.38个百分点,行人提升+7.91个百分点,自行车提升+5.21个百分点,达到当前最优自行车检测性能。

原文摘要 · Abstract (English)

In autonomous driving scenarios, accurate perception is becoming an even more critical task for safe navigation. While LiDAR provides precise spatial data, its inherent sparsity makes it difficult to detect small or distant objects. Existing methods try to address this by generating additional points within a Region of Interest (RoI), but relying on LiDAR alone often leads to false positives and a failure to recover meaningful structures. To address these limitations, we propose Image-Guided Semantic Pseudo-LiDAR Point Generation model, called ImagePG, a novel framework that leverages rich RGB image features to generate dense and semantically meaningful 3D points. Our framework includes an Image-Guided RoI Points Generation (IG-RPG) module, which creates pseudo-points guided by image features, and an Image-Aware Occupancy Prediction Network (I-OPN), which provides spatial priors to guide point placement. A multi-stage refinement (MR) module further enhances point quality and detection robustness. To the best of our knowledge, ImagePG is the first method to directly leverage image features for point generation. Extensive experiments on the KITTI and Waymo datasets demonstrate that ImagePG significantly improves the detection of small and distant objects like pedestrians and cyclists, reducing false positives by nearly 50%. On the KITTI benchmark, our framework improves mAP by +1.38%p (car), +7.91%p (pedestrian), and +5.21%p (cyclist) on the test set over the baseline, achieving state-of-the-art cyclist performance on the KITTI leaderboard. The code is available at: https://github.com/MS-LIMA/ImagePG

3D检测图像引导伪点云自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。