用图结构建模关键点关系,提升相机位姿估计的鲁棒性。
Relational Epipolar Graphs for Robust Relative Camera Pose Estimation

- 将匹配点构建成带边的图,通过图运算推断位姿。
- 在含密集噪声和大基线场景下优于传统与学习方法。
- 适合需要高鲁棒性的视觉定位任务使用。
视觉同时定位与地图构建(VSLAM)中,基于匹配关键点估计相机相对位姿是核心环节,但易受噪声对应影响。传统方法依赖随机采样与迭代,学习方法常缺乏显式几何结构。本文将相对位姿估计重构为在对极对应图上的关系推理问题,其中匹配点为节点,邻近点间以边连接。通过剪枝、消息传递与池化等图操作,联合估计四元数旋转、平移向量及本质矩阵(EM)。损失函数包含:(i) 与真实值的ℓ₂差异,(ii) 估计与真实EM的Frobenius范数,(iii) 奇异值差异,(iv) 方位角差异,(v) 尺度差异。采用无检测器的密集匹配方法LoFTR进行特征匹配。在室内外基准测试中,相比经典与学习引导方法,在密集噪声和大基线变化下均表现出更强鲁棒性,验证了全局关系一致性机制的有效性。
原文摘要 · Abstract (English)
A key component of Visual Simultaneous Localization and Mapping (VSLAM) is estimating relative camera poses using matched keypoints. Accurate estimation is challenged by noisy correspondences. Classical methods rely on stochastic hypothesis sampling and iterative estimation, while learning-based methods often lack explicit geometric structure. In this work, we reformulate relative pose estimation as a relational inference problem over epipolar correspondence graphs, where matched keypoints are nodes and nearby ones are connected by edges. Graph operations such as pruning, message passing, and pooling estimate a quaternion rotation, translation vector, and the Essential Matrix (EM). Minimizing a loss comprising (i) $\mathcal{L}_2$ differences with ground truth (GT), (ii) Frobenius norm between estimated and GT EMs, (iii) singular value differences, (iv) heading angle differences, and (v) scale differences, yields the relative pose between image pairs. The dense detector-free method LoFTR is used for matching. Experiments on indoor and outdoor benchmarks show improved robustness to dense noise and large baseline variation compared to classical and learning-guided approaches, highlighting the effectiveness of global relational consensus.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。