arXiv:2504.21699cs.CVcs.RO2025-04被引 2

构建首个融合激光雷达与4D雷达的三维点云去雨数据集,助力自动驾驶抗雨干扰研究。

REHEARSE-3D: A Multi-modal Emulated Rain Dataset for 3D Point Cloud De-raining

  • 基于真实降雨特征生成多模态点云,含高分辨率激光雷达与4D雷达数据
  • 覆盖昼夜场景,提供点级标注,支持精准雨滴检测与去除评估
  • 适用于自动驾驶传感器去噪、点云修复及多模态融合研究

传感器退化是自动驾驶面临的重要挑战。大雨中雨滴干扰会严重影响激光雷达点云质量,导致点测量不准确,若系统不具备天气感知能力,可能引发安全隐患。本文发布大规模多模态模拟降雨数据集REHEARSE-3D,以推动三维点云去雨研究。该数据集为目前最大点级标注数据集,唯一包含高分辨率激光雷达(LiDAR-256)与4D雷达点云,并在受控天气环境下记录昼夜数据。此外,数据集还包含雨滴特征信息,对传感器噪声建模及点级天气影响分析具有重要价值。基于此,我们对融合激光雷达与4D雷达点云的雨滴检测与去除进行了基准测试,全面评估了多种统计与深度学习模型性能。数据集及基准模型将在论文发表后公开:https://sporsho.github.io/REHEARSE3D。

原文摘要 · Abstract (English)

Sensor degradation poses a significant challenge in autonomous driving. During heavy rainfall, the interference from raindrops can adversely affect the quality of LiDAR point clouds, resulting in, for instance, inaccurate point measurements. This, in turn, can potentially lead to safety concerns if autonomous driving systems are not weather-aware, i.e., if they are unable to discern such changes. In this study, we release a new, large-scale, multi-modal emulated rain dataset, REHEARSE-3D, to promote research advancements in 3D point cloud de-raining. Distinct from the most relevant competitors, our dataset is unique in several respects. First, it is the largest point-wise annotated dataset, and second, it is the only one with high-resolution LiDAR data (LiDAR-256) enriched with 4D Radar point clouds logged in both daytime and nighttime conditions in a controlled weather environment. Furthermore, REHEARSE-3D involves rain-characteristic information, which is of significant value not only for sensor noise modeling but also for analyzing the impact of weather at a point level. Leveraging REHEARSE-3D, we benchmark raindrop detection and removal in fused LiDAR and 4D Radar point clouds. Our comprehensive study further evaluates the performance of various statistical and deep-learning models. Upon publication, the dataset and benchmark models will be made publicly available at: https://sporsho.github.io/REHEARSE3D.

点云去雨自动驾驶多模态数据激光雷达

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。