arXiv:2504.01040cs.CVcs.RO2025-04被引 3

实时检测激光雷达与相机是否偏标,提升自动驾驶安全性。

Cal or No Cal? -- Real-Time Miscalibration Detection of LiDAR and Camera Sensors

论文配图:Cal or No Cal? -- Real-Time Miscalibration Detection of LiDAR and Camera Sensors
图 1 · 摘自论文原文
  • 用对比学习判断传感器是否校准,而非直接计算参数
  • 检测准确率高于现有方法,推理时间更短,资源消耗更低
  • 适合对实时性要求高的自动驾驶系统使用

外参标定的目标是使传感器数据对齐,以准确表征环境并支持多传感器融合。从安全角度,传感器标定是自动驾驶的关键。当前趋势是从基于靶标的离线标定转向无靶标的在线标定,但现有方法难以满足实时性和资源限制,主要因为需估计的参数过多、依赖几何特征或特定车辆动作。为应对这些挑战并确保车辆全程安全,本文提出一种误标定检测框架,将焦点从直接回归标定参数转为二分类任务:校准或未校准。采用对比学习方法,在隐空间比较嵌入特征,实现跨模态传感器状态分类。同时,对特征嵌入和复杂标定误差进行了全面分析,验证了方法的有效性。实验表明,该方法在检测性能、推理时间和资源消耗方面均优于现有最先进方法。代码开源,地址为 https://github.com/TUMFTM/MiscalibrationDetection。

原文摘要 · Abstract (English)

The goal of extrinsic calibration is the alignment of sensor data to ensure an accurate representation of the surroundings and enable sensor fusion applications. From a safety perspective, sensor calibration is a key enabler of autonomous driving. In the current state of the art, a trend from target-based offline calibration towards targetless online calibration can be observed. However, online calibration is subject to strict real-time and resource constraints which are not met by state-of-the-art methods. This is mainly due to the high number of parameters to estimate, the reliance on geometric features, or the dependence on specific vehicle maneuvers. To meet these requirements and ensure the vehicle's safety at any time, we propose a miscalibration detection framework that shifts the focus from the direct regression of calibration parameters to a binary classification of the calibration state, i.e., calibrated or miscalibrated. Therefore, we propose a contrastive learning approach that compares embedded features in a latent space to classify the calibration state of two different sensor modalities. Moreover, we provide a comprehensive analysis of the feature embeddings and challenging calibration errors that highlight the performance of our approach. As a result, our method outperforms the current state-of-the-art in terms of detection performance, inference time, and resource demand. The code is open source and available on https://github.com/TUMFTM/MiscalibrationDetection.

传感器标定自动驾驶实时检测对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。