arXiv:2603.22839cs.CV2026-03被引 1

无需标记,通过物体时空重叠实现多相机实时位姿估计

MultiCam: On-the-fly Multi-Camera Pose Estimation Using Spatiotemporal Overlaps of Known Objects

  • 利用已知物体在多视角间的时空重叠关系构建场景图
  • 在重叠场景中相比现有方法显著提升相机位姿精度
  • 适合动态多相机AR应用,尤其无标记环境

多相机动态增强现实(AR)应用需要统一各摄像头的位姿信息。传统方法依赖初始标定或持续追踪标记物,但标记需在视场内且易受限。为此,我们提出一种基于已知物体时空重叠的在线动态位姿估计方法。通过改进现有物体位姿估计算法,构建时空场景图,实现非重叠视场相机间的关联。我们构建了一个包含静态与动态相机的多相机、多物体位姿数据集,具备时间视场重叠特性。实验表明,在视场重叠场景下,本方法在YCB-V和T-LESS数据集上的相机位姿精度优于当前最优方法。在新旧数据集上均验证了该无标记方法在AR中的有效性。代码与数据集已开源。

原文摘要 · Abstract (English)

Multi-camera dynamic Augmented Reality (AR) applications require a camera pose estimation to leverage individual information from each camera in one common system. This can be achieved by combining contextual information, such as markers or objects, across multiple views. While commonly cameras are calibrated in an initial step or updated through the constant use of markers, another option is to leverage information already present in the scene, like known objects. Another downside of marker-based tracking is that markers have to be tracked inside the field-of-view (FoV) of the cameras. To overcome these limitations, we propose a constant dynamic camera pose estimation leveraging spatiotemporal FoV overlaps of known objects on the fly. To achieve that, we enhance the state-of-the-art object pose estimator to update our spatiotemporal scene graph, enabling a relation even among non-overlapping FoV cameras. To evaluate our approach, we introduce a multi-camera, multi-object pose estimation dataset with temporal FoV overlap, including static and dynamic cameras. Furthermore, in FoV overlapping scenarios, we outperform the state-of-the-art on the widely used YCB-V and T-LESS dataset in camera pose accuracy. Our performance on both previous and our proposed datasets validates the effectiveness of our marker-less approach for AR applications. The code and dataset are available on https://github.com/roth-hex-lab/IEEE-VR-2026-MultiCam.

多相机位姿估计AR无标记

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。