无需标定板即可自校准滚动快门相机参数,提升运动场景下3D视觉精度。
Rolling Shutter Camera Self-Calibration

- 融合两种互补模型,构建统一双投影框架实现自校准。
- 从图像序列中直接估计相机内参与读出时间比,无需额外设备。
- 适用于真实场景,兼具高精度与鲁棒性,适合移动设备部署。
滚动快门(RS)相机广泛用于消费级设备,但其逐行曝光在运动时会产生畸变,使几何3D视觉问题依赖于相机内参与读出时间比。现有校准方法需标定板或专用硬件,限制了在非受限场景中的应用。本文提出首个无需标定板的RS相机自校准方法,可直接从图像序列中估计相机内参和读出时间比。方法基于自校准束调整(BA),结合两种互补模型:一是将RS成像建模为基于行姿态表示的连续时间轨迹估计;二是将RS图像视为时空扭曲的全局快门(GS)图像,需估计校正场。二者结合形成统一的双投影模型,每个3D点同时在行相关时间戳与参考时间戳上受约束,沿共享连续轨迹强化几何与时间一致性。大量仿真分析了不同实现方案在各种条件下的适用性,真实数据实验验证了该方法的准确性、鲁棒性与实用性。
原文摘要 · Abstract (English)
Rolling shutter (RS) cameras are widely used in consumer devices, but their row-wise exposure causes distortions under motion, making geometric 3D vision problems dependent on both camera intrinsics and readout time ratio. Existing RS calibration methods rely on calibration targets or specialised hardware, limiting their use in unconstrained settings. We present the first self-calibration method for RS cameras that directly estimates camera intrinsics and the readout time ratio from image sequences, without requiring calibration targets. The method is implemented as a self-calibrating bundle adjustment (BA), which critically depends on the RS imaging model. We combine two known complementary models. The first formulates RS imaging as continuous-time trajectory estimation under a row-wise pose representation. The second interprets RS images as temporally distorted global shutter (GS) images and requires to estimate correction fields. The combination is non-trivial and results in a unified dual-projection model, in which each 3D point is simultaneously constrained at both row-dependent and reference timestamps along a shared continuous trajectory, enforcing stronger geometric and temporal consistency. Extensive simulations analyse the applicability of several implementations under varying conditions, and real data experiments demonstrate the accuracy, robustness, and practical effectiveness of the proposed approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。