用路边传感器生成车载激光雷达数据,降低自动驾驶训练成本
RS2AD-LiDAR: End-to-End Autonomous Driving LiDAR Data Generation from Roadside Sensor Observations

- 将路边激光雷达点云转换到车端坐标系,虚拟建模合成高保真数据
- 生成数据与真实数据语义相似,训练后提升鸟瞰图和3D检测精度
- 首个从路边数据重建车端激光雷达的方案,适合数据稀缺场景研究
端到端自动驾驶系统直接处理多模态感知数据并输出精细控制指令,已成为主流方向。但现有方法依赖单车数据采集训练,面临成本高、稀有场景少、数据孤岛等问题。为此,本文提出RS2AD-LiDAR框架,从路边传感器观测重建并生成车载激光雷达数据。由于缺乏路边与车端激光雷达高度重叠的公开数据集,本文构建了专用数据集R2V-LiDAR用于评估。具体方法将路边激光雷达点云变换至车端坐标系,并通过虚拟激光雷达建模与点云重采样技术合成高质量车端数据。据我们所知,这是首个从路边输入重建车端激光雷达数据的方法。大量实验表明生成数据与真实数据语义高度相似;对象检测实验显示,将生成数据与真实数据结合训练,可显著提升鸟瞰图(BEV)和3D检测性能,验证了方法有效性。
原文摘要 · Abstract (English)
End-to-end autonomous driving solutions, which directly process multimodal sensory data and output fine-grained control commands, have gradually become a mainstream direction with the development of autonomous driving technology. However, current methods in this category rely on single-vehicle data collection for model training and optimization, which suffers from high acquisition and annotation costs, scarcity of valuable scenarios, and data silos. To address these challenges, we propose RS2AD-LiDAR, a novel framework for reconstructing and generating vehicle-mounted LiDAR data from roadside sensor observations. Since no public dataset currently provides highly overlapping perception coverage between roadside and vehicle-mounted LiDAR sensors, which is essential for studying roadside-to-vehicle data generation, we constructed a dedicated dataset named R2V-LiDAR which is used solely for evaluation in this work. Specifically, our method transforms roadside LiDAR point clouds into the vehicle-mounted LiDAR coordinate system, and synthesizes high-fidelity vehicle-mounted data via virtual LiDAR modeling and point cloud resampling techniques. To the best of our knowledge, this is the first approach to reconstruct vehicle-mounted LiDAR data from roadside sensor inputs. Extensive experimental comparisons demonstrate the semantic similarity between the generated data and real data. Furthermore, object detection experiments show that incorporating the generated data into real data for model training improves both Bird's Eye View (BEV) and 3D detection accuracy, thereby validating the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。