arXiv:2505.02049cs.RO2025-05被引 3

用深度学习提升激光雷达图像色彩与分辨率,改善点云采样精度。

Enhancing Lidar Point Cloud Sampling via Colorization and Super-Resolution of Lidar Imagery

  • 通过深度学习对激光雷达图像进行彩色化和超分辨率重建。
  • 采样点数减少的同时,位移与旋转误差更低,优于现有方法。
  • 适合自动驾驶中弱光、雾天等复杂环境下的点云处理。

近年来激光雷达技术的进步使得点云分辨率提升,并能生成360度、低分辨率的图像,这些图像将深度、反射率或近红外光编码在每个像素中。此类图像使原本为相机RGB图像设计的深度学习方法可直接应用于纯激光雷达系统,无需额外的激光雷达-相机标定。相较于传统RGB图像,激光雷达图像在低光、雾天等恶劣环境下更具鲁棒性。此外,成像能力可缓解长走廊等环境中几何信息退化的问题,避免密集点云带来的误导,防止漂移误差。本文提出一种新框架,利用基于深度学习的彩色化与超分辨率技术处理激光雷达图像,从中提取可靠样本用于里程计估计。增强后的激光雷达图像包含更多信息,有助于更优的关键点检测,进而实现更有效的点云下采样。该方法提升了点云配准精度,缓解了因几何信息不足或冗余点导致的匹配错误。实验结果表明,本方法在使用更少点的情况下,实现了更低的平移和旋转误差,优于先前方法。

原文摘要 · Abstract (English)

Recent advancements in lidar technology have led to improved point cloud resolution as well as the generation of 360 degrees, low-resolution images by encoding depth, reflectivity, or near-infrared light within each pixel. These images enable the application of deep learning (DL) approaches, originally developed for RGB images from cameras to lidar-only systems, eliminating other efforts, such as lidar-camera calibration. Compared with conventional RGB images, lidar imagery demonstrates greater robustness in adverse environmental conditions, such as low light and foggy weather. Moreover, the imaging capability addresses the challenges in environments where the geometric information in point clouds may be degraded, such as long corridors, and dense point clouds may be misleading, potentially leading to drift errors. Therefore, this paper proposes a novel framework that leverages DL-based colorization and super-resolution techniques on lidar imagery to extract reliable samples from lidar point clouds for odometry estimation. The enhanced lidar images, enriched with additional information, facilitate improved keypoint detection, which is subsequently employed for more effective point cloud downsampling. The proposed method enhances point cloud registration accuracy and mitigates mismatches arising from insufficient geometric information or misleading extra points. Experimental results indicate that our approach surpasses previous methods, achieving lower translation and rotation errors while using fewer points.

点云采样激光雷达深度学习里程计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。