arXiv:2503.02300cs.RO2025-03被引 12

用图像扩散模型增强毫米波雷达点云,生成类LiDAR的密集数据

Diffusion-Based mmWave Radar Point Cloud Enhancement Driven by Range Images

  • 将毫米波雷达范围图投影为类图像表示,适配预训练扩散模型
  • 在公开与自建数据集上实现最优性能,生成接近LiDAR的三维点云
  • 适合自动驾驶与机器人感知领域,尤其关注高鲁棒性感知的团队

毫米波雷达在机器人与自动驾驶中备受关注,但其生成的点云稀疏且噪声大,制约发展。传统增强方法难以有效利用扩散模型的超分辨率能力,主要因范围-方位热图(RAH)或鸟瞰图(BEV)表示不自然。为此,本文提出新方法,首次融合范围图与图像扩散模型,通过贴近人类观察的投影方式,使毫米波雷达范围图接近自然图像,从而高效迁移预训练图像扩散模型知识,显著提升性能。在多个公开与自建数据集上的大量实验表明,该方法在生成真正三维类LiDAR点云方面达到当前最优水平。代码将在发表后开源。

原文摘要 · Abstract (English)

Millimeter-wave (mmWave) radar has attracted significant attention in robotics and autonomous driving. However, despite the perception stability in harsh environments, the point cloud generated by mmWave radar is relatively sparse while containing significant noise, which limits its further development. Traditional mmWave radar enhancement approaches often struggle to leverage the effectiveness of diffusion models in super-resolution, largely due to the unnatural range-azimuth heatmap (RAH) or bird's eye view (BEV) representation. To overcome this limitation, we propose a novel method that pioneers the application of fusing range images with image diffusion models, achieving accurate and dense mmWave radar point clouds that are similar to LiDAR. Benefitting from the projection that aligns with human observation, the range image representation of mmWave radar is close to natural images, allowing the knowledge from pre-trained image diffusion models to be effectively transferred, significantly improving the overall performance. Extensive evaluations on both public datasets and self-constructed datasets demonstrate that our approach provides substantial improvements, establishing a new state-of-the-art performance in generating truly three-dimensional LiDAR-like point clouds via mmWave radar. Code will be released after publication.

毫米波雷达点云增强扩散模型自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。