用路边传感器数据生成车载激光雷达数据,降低自动驾驶训练成本。
RS2AD: End-to-End Autonomous Driving Data Generation from Roadside Sensor Observations
- 通过车辆相对位姿将路边激光点云转换到车载坐标系。
- 结合虚拟建模与重采样,合成高保真车载激光雷达数据。
- 可显著提升3D检测精度,适合数据稀缺场景下的模型训练。
端到端自动驾驶系统依赖多模态感知直接输出控制指令,但其训练主要基于单车数据采集,面临数据获取和标注成本高、关键驾驶场景稀缺、数据集碎片化等问题。为此,我们提出RS2AD框架,从路边传感器观测中重建并合成车载激光雷达数据。具体而言,利用目标车辆的相对位姿将路边激光点云映射至车载坐标系,并通过虚拟激光雷达建模、点云分类与重采样技术生成高保真数据。据我们所知,这是首个从路边传感器输入重建车载激光雷达数据的方法。大量实验表明,将RS2AD生成的RS2V-L数据集作为KITTI数据集的补充,能显著提升3D目标检测精度,并大幅提高数据生成效率。结果验证了方法的有效性,表明其有望减少对昂贵车载数据采集的依赖,增强自动驾驶模型鲁棒性。
原文摘要 · Abstract (English)
End-to-end autonomous driving solutions, which process multi-modal sensory data to directly generate refined control commands, have become a dominant paradigm in autonomous driving research. However, these approaches predominantly depend on single-vehicle data collection for model training and optimization, resulting in significant challenges such as high data acquisition and annotation costs, the scarcity of critical driving scenarios, and fragmented datasets that impede model generalization. To mitigate these limitations, we introduce RS2AD, a novel framework for reconstructing and synthesizing vehicle-mounted LiDAR data from roadside sensor observations. Specifically, our method transforms roadside LiDAR point clouds into the vehicle-mounted LiDAR coordinate system by leveraging the target vehicle's relative pose. Subsequently, high-fidelity vehicle-mounted LiDAR data is synthesized through virtual LiDAR modeling, point cloud classification, and resampling techniques. To the best of our knowledge, this is the first approach to reconstruct vehicle-mounted LiDAR data from roadside sensor inputs. Extensive experimental evaluations demonstrate that incorporating the data generated by the RS2AD method (the RS2V-L dataset) into model training as a supplement to the KITTI dataset can significantly enhance the accuracy of 3D object detection and greatly improve the efficiency of end-to-end autonomous driving data generation. These findings strongly validate the effectiveness of the proposed method and underscore its potential in reducing dependence on costly vehicle-mounted data collection while improving the robustness of autonomous driving models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。