用激光雷达数据训练GAN,提升雷达图像清晰度。
A Generative Adversarial Network-based Method for LiDAR-Assisted Radar Image Enhancement

- 以高分辨率激光雷达图为真值,训练GAN从低分辨雷达图生成细节更丰富的图像。
- 生成的增强图像在恶劣天气下仍能更清晰呈现物体特征。
- 适合自动驾驶中需提升雷达感知精度的研究者使用。
本文提出一种基于生成对抗网络(GAN)的雷达图像增强方法。尽管雷达传感器在恶劣天气下仍具鲁棒性,但其在自动驾驶(AV)中的应用常受限于生成的低分辨率数据。本研究旨在增强雷达图像,以更准确地描绘环境细节和特征,从而提升自动驾驶中的目标识别能力。所提方法利用高分辨率二维(2D)投影激光雷达点云作为真实图像标签,低分辨率雷达图像作为输入进行GAN训练。真实图像通过两步获得:首先累积原始激光雷达扫描生成点云地图;其次采用定制的激光雷达点云裁剪与投影方法生成2D投影点云。推理阶段仅依赖雷达图像生成增强版本。定性与定量结果均表明,该方法可生成比输入雷达图像更清晰的物体表示,即使在恶劣天气条件下亦然。
原文摘要 · Abstract (English)
This paper presents a generative adversarial network (GAN) based approach for radar image enhancement. Although radar sensors remain robust for operations under adverse weather conditions, their application in autonomous vehicles (AVs) is commonly limited by the low-resolution data they produce. The primary goal of this study is to enhance the radar images to better depict the details and features of the environment, thereby facilitating more accurate object identification in AVs. The proposed method utilizes high-resolution, two-dimensional (2D) projected light detection and ranging (LiDAR) point clouds as ground truth images and low-resolution radar images as inputs to train the GAN. The ground truth images were obtained through two main steps. First, a LiDAR point cloud map was generated by accumulating raw LiDAR scans. Then, a customized LiDAR point cloud cropping and projection method was employed to obtain 2D projected LiDAR point clouds. The inference process of the proposed method relies solely on radar images to generate an enhanced version of them. The effectiveness of the proposed method is demonstrated through both qualitative and quantitative results. These results show that the proposed method can generate enhanced images with clearer object representation compared to the input radar images, even under adverse weather conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。