arXiv:2601.01188cs.ROcs.CV2026-01

无需标定板的自监督激光雷达-相机标定网络,支持实时自适应校准。

DST-Calib: A Dual-Path, Self-Supervised, Target-Free LiDAR-Camera Extrinsic Calibration Network

  • 采用双路径自监督框架,结合双向数据增强提升泛化能力。
  • 在五个公开数据集上误差降低30%以上,显著优于现有方法。
  • 适合无人车、机器人等需动态校准的真实场景部署。

激光雷达-相机外参标定对机器人感知系统中的多模态数据融合至关重要。然而,现有方法通常依赖人工设计的标定靶(如棋盘格)或特定静态场景,限制了其在真实世界自主和机器人应用中的适应性与部署。本文提出首个自监督、在线式、无需特定标定目标的激光雷达-相机外参标定网络。我们发现先前方法存在显著泛化性能下降问题,源于传统的单侧数据增强策略。为此,提出一种新型双向数据增强技术,利用估计深度图生成多视角相机图像,提升训练过程中的鲁棒性与多样性。基于此增强策略,构建双路径自监督标定框架,降低对高精度真值标签的依赖,并支持完全自适应的在线标定。此外,为改善跨模态特征关联,用差异图构建取代传统双分支特征提取,显式关联激光雷达与相机特征,不仅提升标定精度,还减少模型复杂度。在五个公开基准数据集及自建数据集上的大量实验表明,所提方法在泛化能力方面显著优于现有方法。

原文摘要 · Abstract (English)

LiDAR-camera extrinsic calibration is essential for multi-modal data fusion in robotic perception systems. However, existing approaches typically rely on handcrafted calibration targets (e.g., checkerboards) or specific, static scene types, limiting their adaptability and deployment in real-world autonomous and robotic applications. This article presents the first self-supervised LiDAR-camera extrinsic calibration network that operates in an online fashion and eliminates the need for specific calibration targets. We first identify a significant generalization degradation problem in prior methods, caused by the conventional single-sided data augmentation strategy. To overcome this limitation, we propose a novel double-sided data augmentation technique that generates multi-perspective camera views using estimated depth maps, thereby enhancing robustness and diversity during training. Built upon this augmentation strategy, we design a dual-path, self-supervised calibration framework that reduces the dependence on high-precision ground truth labels and supports fully adaptive online calibration. Furthermore, to improve cross-modal feature association, we replace the traditional dual-branch feature extraction design with a difference map construction process that explicitly correlates LiDAR and camera features. This not only enhances calibration accuracy but also reduces model complexity. Extensive experiments conducted on five public benchmark datasets, as well as our own recorded dataset, demonstrate that the proposed method significantly outperforms existing approaches in terms of generalizability.

标定自监督多模态机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。