arXiv:2506.15560cs.CVcs.RO2025-06被引 2

用稀疏激光雷达监督雷达深度估计,提升精度同时大幅降低数据成本

RaCalNet: Radar Calibration Network for Sparse-Supervised Metric Depth Estimation

  • 用稀疏激光雷达校准雷达点云,生成高精度深度先验
  • 仅需1%监督密度,实测深度误差降低34.89%
  • 适合自动驾驶中低成本高精度雷达深度感知场景

毫米波雷达稠密深度估计通常需要通过多帧投影与插值生成的稠密激光雷达监督,代价高昂。为此,我们提出RaCalNet,无需稠密监督,仅用稀疏激光雷达即可指导雷达测量的精细化学习,监督密度仅为稠密方法的约1%。该框架包含两个核心模块:雷达重校准模块对雷达点进行筛选并优化像素级位移,从稀疏输入中生成准确可靠的深度先验;度量深度优化模块学习场景尺度先验,并与单目深度预测融合,实现度量准确的输出。模块化设计增强了结构一致性并保留细粒度几何细节。尽管仅依赖稀疏监督,RaCalNet仍生成轮廓清晰、纹理丰富的深度图,视觉质量优于现有稠密监督方法。定量上,在ZJU-4DRadarCam数据集上性能相当,真实场景部署中RMSE降低34.89%。

原文摘要 · Abstract (English)

Dense depth estimation using millimeter-wave radar typically requires dense LiDAR supervision, generated via multi-frame projection and interpolation, for guiding the learning of accurate depth from sparse radar measurements and RGB images. However, this paradigm is both costly and data-intensive. To address this, we propose RaCalNet, a novel framework that eliminates the need for dense supervision by using sparse LiDAR to supervise the learning of refined radar measurements, resulting in a supervision density of merely around 1\% compared to dense-supervised methods. RaCalNet is composed of two key modules. The Radar Recalibration module performs radar point screening and pixel-wise displacement refinement, producing accurate and reliable depth priors from sparse radar inputs. These priors are then used by the Metric Depth Optimization module, which learns to infer scene-level scale priors and fuses them with monocular depth predictions to achieve metrically accurate outputs. This modular design enhances structural consistency and preserves fine-grained geometric details. Despite relying solely on sparse supervision, RaCalNet produces depth maps with clear object contours and fine-grained textures, demonstrating superior visual quality compared to state-of-the-art dense-supervised methods. Quantitatively, it achieves performance comparable to existing methods on the ZJU-4DRadarCam dataset and yields a 34.89\% RMSE reduction in real-world deployment scenarios. We plan to gradually release the code and models in the future at https://github.com/818slam/RaCalNet.git.

雷达深度估计稀疏监督自动驾驶深度优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。