arXiv:2507.23595cs.CV2025-07ICCV被引 3

无需标定物和人工干预,用车载激光雷达实现路侧摄像头自动校准。

MamV2XCalib: V2X-based Target-less Infrastructure Camera Calibration with State Space Model

  • 利用车载激光雷达与路侧摄像头的协同数据,通过状态空间模型处理时序信息。
  • 在真实数据集上达到优于传统方法的稳定校准精度,参数更少。
  • 适合大规模智能交通系统部署,尤其适用于城市道路复杂场景。

随着基于路边摄像头辅助自动驾驶感知的协作系统日益普及,基础设施摄像头的大规模精确校准成为关键问题。传统人工校准方法耗时费力,常需封闭道路。本文提出MamV2XCalib,首个基于车联网(V2X)的无标定物摄像头校准方法,借助车载激光雷达完成校准。仅需配备激光雷达的自动驾驶车辆驶过待校准摄像头附近即可,无需特定参考物或人工干预。我们引入一种新的无标定物激光雷达-相机校准方法,结合多尺度特征与4D相关体积,估计车端点云与路侧图像间的关联性。采用Mamba建模时序信息,有效缓解因车载数据缺陷(如遮挡)及视角差异导致的校准失败问题。在V2X-Seq和TUMTraf-V2X真实数据集上评估,验证了本方法在V2X场景下的有效性与鲁棒性。相比专为单车设计的以往激光雷达-相机方法,本方案在参数更少的前提下实现了更优且更稳定的校准性能。代码已开源:https://github.com/zhuyaoye/MamV2XCalib。

原文摘要 · Abstract (English)

As cooperative systems that leverage roadside cameras to assist autonomous vehicle perception become increasingly widespread, large-scale precise calibration of infrastructure cameras has become a critical issue. Traditional manual calibration methods are often time-consuming, labor-intensive, and may require road closures. This paper proposes MamV2XCalib, the first V2X-based infrastructure camera calibration method with the assistance of vehicle-side LiDAR. MamV2XCalib only requires autonomous vehicles equipped with LiDAR to drive near the cameras to be calibrated in the infrastructure, without the need for specific reference objects or manual intervention. We also introduce a new targetless LiDAR-camera calibration method, which combines multi-scale features and a 4D correlation volume to estimate the correlation between vehicle-side point clouds and roadside images. We model the temporal information and estimate the rotation angles with Mamba, effectively addressing calibration failures in V2X scenarios caused by defects in the vehicle-side data (such as occlusions) and large differences in viewpoint. We evaluate MamV2XCalib on the V2X-Seq and TUMTraf-V2X real-world datasets, demonstrating the effectiveness and robustness of our V2X-based automatic calibration approach. Compared to previous LiDAR-camera methods designed for calibration on one car, our approach achieves better and more stable calibration performance in V2X scenarios with fewer parameters. The code is available at https://github.com/zhuyaoye/MamV2XCalib.

V2X摄像头校准激光雷达状态空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。