arXiv:2507.22733cs.CV2025-07ICCV被引 3

解决异步摄像头下的三维结构与运动估计问题,支持多种传感器融合。

A Linear N-Point Solver for Structure and Motion from Asynchronous Tracks

  • 基于一阶动力学和匀速模型,建立线性点对应关系。
  • 可处理任意时间戳的特征点匹配,支持多类传感器数据。
  • 适用于滚动快门、事件相机等异步场景,代码开源。

从点对应关系中进行结构与连续运动估计是计算机视觉的基础问题,传统方法如5点或8点算法仅适用于瞬时捕获的双视图数据。然而,在滚动快门相机或事件相机等场景下,图像同步性被破坏。本文提出一种统一方法,可从任意时间戳的2D点对应关系中恢复三维结构与线性运动。通过建模一阶动力学并采用匀速运动假设,推导出新的线性点共面关系,实现高效求解,且具有可预测的退化情况和解的多重性。该方法适用于全局快门、滚动快门及事件相机等多种感知模态,甚至可融合共位传感器的数据。在仿真与真实数据上验证了其有效性,相比近期方法在所有模态下均有稳定提升。代码已开源。

原文摘要 · Abstract (English)

Structure and continuous motion estimation from point correspondences is a fundamental problem in computer vision that has been powered by well-known algorithms such as the familiar 5-point or 8-point algorithm. However, despite their acclaim, these algorithms are limited to processing point correspondences originating from a pair of views each one representing an instantaneous capture of the scene. Yet, in the case of rolling shutter cameras, or more recently, event cameras, this synchronization breaks down. In this work, we present a unified approach for structure and linear motion estimation from 2D point correspondences with arbitrary timestamps, from an arbitrary set of views. By formulating the problem in terms of first-order dynamics and leveraging a constant velocity motion model, we derive a novel, linear point incidence relation allowing for the efficient recovery of both linear velocity and 3D points with predictable degeneracies and solution multiplicities. Owing to its general formulation, it can handle correspondences from a wide range of sensing modalities such as global shutter, rolling shutter, and event cameras, and can even combine correspondences from different collocated sensors. We validate the effectiveness of our solver on both simulated and real-world data, where we show consistent improvement across all modalities when compared to recent approaches. We believe our work opens the door to efficient structure and motion estimation from asynchronous data. Code can be found at https://github.com/suhang99/AsyncTrack-Motion-Solver.

三维重建异步数据事件相机运动估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。