arXiv:2604.19420cs.CV2026-04中稿 · CVPR

实时优化立体相机标定,精度达0.12度,无需训练

TESO: Online Tracking of Essential Matrix by Stochastic Optimization

论文配图:TESO: Online Tracking of Essential Matrix by Stochastic Optimization
图 1 · 摘自论文原文
  • 基于核相关设计鲁棒损失函数,结合在线随机优化
  • 在Y轴上跟踪误差仅0.12度,深度精度提升50倍
  • 适合资源受限的在线感知系统,轻量无训练

维持立体相机校准参数的长期准确性对自主系统感知至关重要。本文提出基于随机优化的在线本质矩阵追踪方法(TESO)。其核心机制包括:1)基于候选匹配对的核相关鲁棒损失函数;2)在本质流形上的自适应在线随机优化。TESO具有低CPU与内存开销,依赖少量超参数,无需数据驱动训练,适用于资源受限的在线感知系统。我们在大规模MAN TruckScenes数据集上评估了其对几何精度、矫正质量及立体深度一致性的影响。TESO在Y轴上实现0.12度的旋转校准漂移跟踪精度(对立体精度关键),而X轴和Z轴精度高五倍。在模拟漂移序列中,追踪精度与无漂移序列相当,表明追踪器无偏差。在KITTI数据集上,TESO揭示了多个立体对间存在系统性外参不一致,证实了已有研究结论。验证发现内参失调导致该误差,表现为矫正与深度指标行为冲突。校正参考标定后,Y轴旋转精度提升20倍至0.025度,深度精度提升50倍。尽管设计轻量,直接优化所提损失函数即可达到与神经网络单帧方法相当的精度。

原文摘要 · Abstract (English)

Maintaining long-term accuracy of stereo camera calibration parameters is important for autonomous systems' perception. This work proposes Online Tracking of Essential Matrix by Stochastic Optimization (TESO). The core mechanisms of TESO are: 1) a robust loss function based on kernel correlation over tentative correspondences, 2) an adaptive online stochastic optimization on the essential manifold. TESO has low CPU and memory requirements, relies on a few hyperparameters, and eliminates the need for data-driven training, enabling the usage in resource-constrained online perception systems. We evaluated the influence of TESO on geometric precision, rectification quality, and stereo depth consistency. On the large-scale MAN TruckScenes dataset, TESO tracks rotational calibration drift with 0.12 deg precision in the Y-axis (critical for stereo accuracy) while the X- and Z-axes are five times more precise. Tracking applied to sequences with simulated drift shows similar precision with respect to the reference as tracking applied to no-drift sequences, indicating the tracker is unbiased. On the KITTI dataset, TESO revealed systematic inconsistencies in extrinsic parameters across stereo pairs, confirming previous published findings. We verified that intrinsic decalibration affected these errors, as evidenced by the conflicting behavior of the rectification and depth metrics. After correcting the reference calibration, TESO improved its rotation precision around the Y-axis 20 times to 0.025 deg and its depth accuracy 50 times. Despite its lightweight design, direct optimization of the proposed TESO loss function alone achieves accuracy comparable to that of neural network-based single-frame methods.

立体视觉在线优化标定轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。