arXiv:2504.04451cs.RO2025-04被引 2

解决事件相机立体系统的时间空间标定问题,提升运动估计精度。

eKalibr-Stereo: Continuous-Time Spatiotemporal Calibration for Event-Based Stereo Visual Systems

  • 基于运动先验追踪不完整网格图案,增强连续性
  • 两步初始化加连续时间批量优化,实现高精度标定
  • 适用于机器人感知与动态场景下的事件相机系统

仿生事件相机凭借极高的时间分辨率、宽动态范围和低功耗,在运动估计、机器人感知和目标检测中备受关注。在自运动估计中,立体事件相机配置因可直接获取尺度信息和深度恢复而被广泛采用。为实现最优立体视觉融合,需精确的时空(外参与时序)标定。由于针对事件相机的立体视觉标定器极少,本文在先前工作eKalibr(事件相机内参标定器)基础上,提出eKalibr-Stereo,用于事件相机立体系统的准确时空标定。为提升网格图案追踪的连续性,基于eKalibr中的网格识别方法,设计了基于运动先验的追踪模块以处理不完整网格。基于追踪结果,采用两步初始化恢复分段B样条及时空参数初值,再通过连续时间批量束调整进行优化,获得最优解。大量真实世界实验表明,eKalibr-Stereo可实现高精度事件相机立体时空标定。代码已开源,供研究社区使用。

原文摘要 · Abstract (English)

The bioinspired event camera, distinguished by its exceptional temporal resolution, high dynamic range, and low power consumption, has been extensively studied in recent years for motion estimation, robotic perception, and object detection. In ego-motion estimation, the stereo event camera setup is commonly adopted due to its direct scale perception and depth recovery. For optimal stereo visual fusion, accurate spatiotemporal (extrinsic and temporal) calibration is required. Considering that few stereo visual calibrators orienting to event cameras exist, based on our previous work eKalibr (an event camera intrinsic calibrator), we propose eKalibr-Stereo for accurate spatiotemporal calibration of event-based stereo visual systems. To improve the continuity of grid pattern tracking, building upon the grid pattern recognition method in eKalibr, an additional motion prior-based tracking module is designed in eKalibr-Stereo to track incomplete grid patterns. Based on tracked grid patterns, a two-step initialization procedure is performed to recover initial guesses of piece-wise B-splines and spatiotemporal parameters, followed by a continuous-time batch bundle adjustment to refine the initialized states to optimal ones. The results of extensive real-world experiments show that eKalibr-Stereo can achieve accurate event-based stereo spatiotemporal calibration. The implementation of eKalibr-Stereo is open-sourced at (https://github.com/Unsigned-Long/eKalibr) to benefit the research community.

事件相机立体标定时空校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。