arXiv:2608.22965cs.CV2026-08中稿 · the 37th British M…

用动态图案实现无运动、免同步的事件相机与摄像头校准。

Simplified Cross-Modal Calibration for Heterogeneous Event-RGB Stereo Systems

论文配图:Simplified Cross-Modal Calibration for Heterogeneous Event-RGB Stereo Systems
图 1 · 摘自论文原文
  • 用明暗交替的混合棋盘格图案触发事件,同时保持可见性。
  • 相比最强基准方法,重投影误差降低44%,且无需传感器运动。
  • 适合机器人视觉、自动驾驶等需快速部署的多模态系统。

事件相机与帧相机之间的精确外参标定仍是异构立体系统的关键难题。现有方法常依赖传感器或目标运动、高精度同步,或计算复杂的事件到图像重建。本文提出一种简单、无运动的跨模态标定框架,采用在普通消费级显示器上呈现的时间调制混合ChArUco靶标。通过在原始图案与部分融合版本间交替显示,靶标可稳定触发事件,同时持续被帧相机捕捉,避免空白帧并仅需粗粒度触发对齐。将事件离散化为与RGB图像粗对齐的帧,进行轻量去噪后,基于ChArUco完成内参与立体外参标定。大量实验验证了对融合透明度、屏幕亮度、环境光照、视角及手持采集的鲁棒性。相比最强运动基准(E2Calib + Kalibr)和非运动基准(Plasberg et al.),本方法分别将平均重投影误差降低44%和6%,显著简化流程。最后在机器人眼手标定案例中展示实际应用价值,即使存在部分遮挡,仍能保持一致的变换与稳定的几何测量。代码已公开:https://github.com/nhessenthaler/simple-evrgb-cal。

原文摘要 · Abstract (English)

Accurate extrinsic calibration between event-based and frame-based cameras remains a practical bottleneck for heterogeneous stereo systems. Existing approaches often require sensor or target motion, precise synchronization, or computationally expensive event-to-image reconstruction. We propose a simple, motion-free cross-modal calibration framework that uses a temporally modulated, blended ChArUco target presented on standard consumer displays. By alternating between the original pattern and a partially blended version, the target reliably triggers events while remaining continuously observable to a frame-based camera, avoiding blank frames and reducing synchronization constraints to a coarse, trigger-based alignment. We discretize events into frames coarsely aligned with the RGB images, apply lightweight denoising, and perform ChArUco-based intrinsic and stereo extrinsic calibration. Extensive experiments assess robustness to blending opacity, display brightness, external illumination, viewing angle, and handheld acquisition. Compared to the strongest motion-based reference (E2Calib + Kalibr) and a non-motion-based reference (Plasberg et al.), our approach reduces the mean reprojection error by $44\%$ and $6\%$, respectively, while substantially simplifying the calibration procedure. Finally, we demonstrate practical utility in a robotic eye-to-hand calibration case study, showing consistent transformations and stable downstream geometric measurements even under partial occlusions. Code is publicly available at https://github.com/nhessenthaler/simple-evrgb-cal.

多模态校准事件相机立体视觉机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。