arXiv:2605.07491cs.CV2026-05

用高斯过程隐式校准多相机系统,兼具精度与不确定性评估。

Implicit Multi-Camera System Calibration Using Gaussian Processes

论文配图:Implicit Multi-Camera System Calibration Using Gaussian Processes
图 1 · 摘自论文原文
  • 直接学习2D图像到3D世界的非线性映射,跳过参数估计
  • 预测不确定性随靠近摄像头而升高,符合数据稀疏分布规律
  • 结合主动学习提升数据效率,适合难以获取大量标定数据的场景

本文提出一种基于高斯过程回归的隐式多相机系统校准新框架。传统显式校准方法受限于刚性数学模型,难以处理非常规光学带来的复杂非线性畸变;现有神经网络隐式方法通常依赖大量数据且缺乏内在不确定性量化(UQ)。所提方法直接学习所有相机2D图像坐标到3D世界坐标的复杂非线性映射,完全规避了繁琐的内外参显式估计。同时,其固有的不确定性量化对将3D点预测转化为可验证的测量结果至关重要,可提供统计上合理的置信区间。为提升数据效率与实用性,引入主动学习(AL),利用高斯过程的预测不确定性智能引导新校准数据的采集。实验表明,3D预测的不确定性在靠近相机区域更高,这与该区域在uv坐标空间中数据点更稀疏一致。本工作对需校准复杂多相机系统的研究者具有重要参考价值。

原文摘要 · Abstract (English)

This paper proposes a novel framework for implicit multi-camera system calibration utilizing Gaussian Process (GP) regression. Conventional explicit calibration methods are constrained by rigid mathematical models and struggle with complex, non-linear distortions from unconventional optics, while existing neural network-based implicit approaches are typically data-hungry and lack inherent uncertainty quantification (UQ). Our GP-based model directly learns the complex, non-linear mapping from 2D image coordinates across all cameras to a 3D world coordinate, completely bypassing time-consuming estimation of explicit intrinsic and extrinsic parameters. Moreover, the inherent UQ is critical for transforming a simple 3D point prediction into a verifiable 3D measurement, complete with statistically-sound confidence bounds. To further enhance data efficiency and practical deployment, we integrate Active Learning (AL), which intelligently leverages the GP's predictive uncertainty to strategically guide the acquisition of new calibration data. This approach results in a robust, data-efficient, and reliable calibration solution, proving particularly effective in practical scenarios where collecting extensive calibration data is a dominant constraint. Our experiments show that the uncertainty for the 3D predictions is higher closer to the cameras. The data points in $uv$-coordinate space are more sparse in that region, even though they are not in 3D space. This work is relevant for anyone who is tasked with the calibration of complex multi-camera systems.

多相机校准高斯过程不确定性量化主动学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。