arXiv:2601.09812cs.CVcs.RO2026-01被引 5

融合视觉与激光雷达数据,提升自动驾驶中3D目标检测的准确率和实时性。

LCF3D: A Robust and Real-Time Late-Cascade Fusion Framework for 3D Object Detection in Autonomous Driving

  • 采用晚期融合与级联融合策略,减少误检并补全漏检。
  • 在KITTI和nuScenes上对行人、自行车等类别检测精度显著提升。
  • 适用于不同传感器配置场景,具备强泛化能力,适合实际部署。

在自动驾驶中,精准定位行人、骑行者及其它车辆等3D物体至关重要。为保障高检测性能,自动驾驶系统通常结合使用RGB相机与激光雷达(LiDAR),但如何有效融合多源数据仍是挑战。本文提出LCF3D,一种新型传感器融合框架,将基于RGB图像的2D目标检测器与基于LiDAR点云的3D目标检测器相结合。通过多模态融合机制,弥补LiDAR检测网络的不足:(i) 晚期融合——将LiDAR 3D检测结果与RGB 2D检测匹配,剔除未匹配的虚假检测;(ii) 级联融合——对未匹配的RGB检测生成新的3D锥形提案,恢复遗漏的物体。实验表明,LCF3D在域泛化方面表现优异,能有效应对训练与测试阶段传感器配置差异。在KITTI数据集上对行人、骑行者等困难类别,在nuScenes上对摩托车、自行车等类别均取得显著提升。代码已开源:https://github.com/CarloSgaravatti/LCF3D。

原文摘要 · Abstract (English)

Accurately localizing 3D objects like pedestrians, cyclists, and other vehicles is essential in Autonomous Driving. To ensure high detection performance, Autonomous Vehicles complement RGB cameras with LiDAR sensors, but effectively combining these data sources for 3D object detection remains challenging. We propose LCF3D, a novel sensor fusion framework that combines a 2D object detector on RGB images with a 3D object detector on LiDAR point clouds. By leveraging multimodal fusion principles, we compensate for inaccuracies in the LiDAR object detection network. Our solution combines two key principles: (i) late fusion, to reduce LiDAR False Positives by matching LiDAR 3D detections with RGB 2D detections and filtering out unmatched LiDAR detections; and (ii) cascade fusion, to recover missed objects from LiDAR by generating new 3D frustum proposals corresponding to unmatched RGB detections. Experiments show that LCF3D is beneficial for domain generalization, as it turns out to be successful in handling different sensor configurations between training and testing domains. LCF3D achieves significant improvements over LiDAR-based methods, particularly for challenging categories like pedestrians and cyclists in the KITTI dataset, as well as motorcycles and bicycles in nuScenes. Code can be downloaded from: https://github.com/CarloSgaravatti/LCF3D.

3D检测多模态融合自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。