arXiv:2409.02310cs.CV2024-09被引 6

融合几何信息提升大尺度图像匹配精度与密度

Geometry-Aware Feature Matching for Large-Scale Structure from Motion

  • 结合颜色与几何约束优化特征匹配,填补视图重叠少时的匹配空白
  • 在基准数据集上显著提升相机位姿精度与点云密度,优于当前最优方法
  • 适合处理极端大规模场景下的图像匹配,尤其适用于视图变化剧烈的场景

在多视角三维重建中,建立跨图像的一致且密集的对应关系至关重要。当存在显著视图变化(如空对地拍摄且视图重叠极稀疏)时,传统匹配方法面临更大挑战。本文提出一种基于优化的新方法,通过引入几何线索增强现有特征匹配技术,弥补大尺度场景下重叠不足带来的匹配缺口。该方法将几何验证建模为优化问题,指导无检测器方法的匹配过程,并利用有检测器方法生成的稀疏对应作为锚点。通过施加萨姆森距离的几何约束,确保无检测器方法获得的更密集对应具有几何一致性与更高准确性。这种混合策略显著提升了对应密度与精度,缓解了多视图不一致性问题,大幅改善相机位姿估计精度与点云密度。实验表明,该方法在多个基准数据集上超越当前最优方法,并成功应用于极具挑战性的超大规模场景匹配任务。

原文摘要 · Abstract (English)

Establishing consistent and dense correspondences across multiple images is crucial for Structure from Motion (SfM) systems. Significant view changes, such as air-to-ground with very sparse view overlap, pose an even greater challenge to the correspondence solvers. We present a novel optimization-based approach that significantly enhances existing feature matching methods by introducing geometry cues in addition to color cues. This helps fill gaps when there is less overlap in large-scale scenarios. Our method formulates geometric verification as an optimization problem, guiding feature matching within detector-free methods and using sparse correspondences from detector-based methods as anchor points. By enforcing geometric constraints via the Sampson Distance, our approach ensures that the denser correspondences from detector-free methods are geometrically consistent and more accurate. This hybrid strategy significantly improves correspondence density and accuracy, mitigates multi-view inconsistencies, and leads to notable advancements in camera pose accuracy and point cloud density. It outperforms state-of-the-art feature matching methods on benchmark datasets and enables feature matching in challenging extreme large-scale settings.

结构从运动特征匹配几何约束大尺度重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。