arXiv:2409.14170cs.CV2024-09

用车道作为融合单元,提升自动驾驶规划效率与精度。

LFP: Efficient and Accurate End-to-End Lane-Level Planning via Camera-LiDAR Fusion

  • 以车道为单位进行相机与激光雷达融合,减少冗余计算。
  • 在Carla上实现19.27帧/秒,驾驶得分提升15%、违规得分提升14%。
  • 适合追求高实时性与高精度的自动驾驶系统研发人员。

多模态系统虽能提升自动驾驶性能,但因各模态盲目处理信息而效率低下,且模态间特征学习独立,缺乏交互,导致融合时冗余信息成本增加。为此,本文聚焦驾驶相关元素,减少激光雷达特征量并保留关键信息,增强图像与激光雷达分支间的车道级交互,实现各自优势特征的提取与融合。基于纯相机框架PHP,提出车道级相机-激光雷达融合规划(LFP)方法,通过三个模块兼顾效率与性能。为提升效率,设计图像引导的粗粒度车道先验生成模块,预测车道感兴趣区域(ROI)并赋信心分数,指导激光雷达处理;激光雷达特征提取模块利用图像分支提供的车道感知先验,指导柱状体采样,保留关键柱体。为提升性能,设计车道级跨模态查询融合与特征增强模块,利用ROI信心分数将低置信度图像查询与激光雷达查询结合,提取互补深度特征,增强低置信度图像特征,弥补深度缺失。在Carla基准测试中,本方法在驾驶得分和违规得分上均达到当前最优,最大提升分别为15%和14%,同时保持19.27 FPS的高帧率。

原文摘要 · Abstract (English)

Multi-modal systems enhance performance in autonomous driving but face inefficiencies due to indiscriminate processing within each modality. Additionally, the independent feature learning of each modality lacks interaction, which results in extracted features that do not possess the complementary characteristics. These issue increases the cost of fusing redundant information across modalities. To address these challenges, we propose targeting driving-relevant elements, which reduces the volume of LiDAR features while preserving critical information. This approach enhances lane level interaction between the image and LiDAR branches, allowing for the extraction and fusion of their respective advantageous features. Building upon the camera-only framework PHP, we introduce the Lane-level camera-LiDAR Fusion Planning (LFP) method, which balances efficiency with performance by using lanes as the unit for sensor fusion. Specifically, we design three modules to enhance efficiency and performance. For efficiency, we propose an image-guided coarse lane prior generation module that forecasts the region of interest (ROI) for lanes and assigns a confidence score, guiding LiDAR processing. The LiDAR feature extraction modules leverages lane-aware priors from the image branch to guide sampling for pillar, retaining essential pillars. For performance, the lane-level cross-modal query integration and feature enhancement module uses confidence score from ROI to combine low-confidence image queries with LiDAR queries, extracting complementary depth features. These features enhance the low-confidence image features, compensating for the lack of depth. Experiments on the Carla benchmarks show that our method achieves state-of-the-art performance in both driving score and infraction score, with maximum improvement of 15% and 14% over existing algorithms, respectively, maintaining high frame rate of 19.27 FPS.

自动驾驶传感器融合车道规划高效算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。