用高斯点云建模雷达噪声,实现真实场景下的高保真雷达数据生成与3D重建。
RadarSplat: Radar Gaussian Splatting for High-Fidelity Data Synthesis and 3D Reconstruction of Autonomous Driving Scenes
- 将高斯溅射与雷达噪声模型结合,模拟真实雷达干扰。
- 合成图像比现有方法提升3.4dB PSNR、2.6倍SSIM,几何重建误差降低40%。
- 适合自动驾驶仿真、传感器融合研究者使用,尤其关注恶劣天气场景。
高保真3D场景重建在自动驾驶中至关重要,可从现有数据集生成新数据,用于模拟安全关键场景并扩充训练集,无需额外采集成本。尽管辐射场在相机和激光雷达的3D重建与数据合成方面取得进展,其在雷达领域的应用仍不充分。雷达因在雨、雾、雪等恶劣天气下表现稳定而对自动驾驶极为关键,但现有最先进雷达神经表示在存在显著雷达噪声(如接收器饱和、多路径反射)时性能下降,且仅能合成预处理过的无噪雷达图像,无法实现真实雷达数据合成。为此,本文提出RadarSplat,通过将高斯溅射与新型雷达噪声建模结合,实现真实雷达数据合成与增强的3D重建。相比当前最优方法,RadarSplat在雷达图像合成上提升3.4 PSNR、2.6倍SSIM,几何重建误差降低40%,准确率提升1.5倍,验证了其在生成高保真雷达数据与场景重建中的有效性。项目页面见 https://umautobots.github.io/radarsplat。
原文摘要 · Abstract (English)
High-Fidelity 3D scene reconstruction plays a crucial role in autonomous driving by enabling novel data generation from existing datasets. This allows simulating safety-critical scenarios and augmenting training datasets without incurring further data collection costs. While recent advances in radiance fields have demonstrated promising results in 3D reconstruction and sensor data synthesis using cameras and LiDAR, their potential for radar remains largely unexplored. Radar is crucial for autonomous driving due to its robustness in adverse weather conditions like rain, fog, and snow, where optical sensors often struggle. Although the state-of-the-art radar-based neural representation shows promise for 3D driving scene reconstruction, it performs poorly in scenarios with significant radar noise, including receiver saturation and multipath reflection. Moreover, it is limited to synthesizing preprocessed, noise-excluded radar images, failing to address realistic radar data synthesis. To address these limitations, this paper proposes RadarSplat, which integrates Gaussian Splatting with novel radar noise modeling to enable realistic radar data synthesis and enhanced 3D reconstruction. Compared to the state-of-the-art, RadarSplat achieves superior radar image synthesis (+3.4 PSNR / 2.6x SSIM) and improved geometric reconstruction (-40% RMSE / 1.5x Accuracy), demonstrating its effectiveness in generating high-fidelity radar data and scene reconstruction. A project page is available at https://umautobots.github.io/radarsplat.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。