提出多图注意力网络,提升两视图匹配的几何一致性与鲁棒性。
MGCA-Net: Multi-Graph Contextual Attention Network for Two-View Correspondence Learning

- 通过上下文几何注意力动态融合位置与特征信息
- 跨阶段稀疏图网络实现几何共识,显著减少误匹配
- 在YFCC100M和SUN3D上优于当前最优方法
两视图对应学习是计算机视觉中的关键任务,用于相机位姿估计和三维重建等应用。现有方法在局部几何建模和跨阶段信息优化方面存在局限,难以准确捕捉匹配对的几何约束,从而降低模型鲁棒性。为此,本文提出多图上下文注意力网络(MGCA-Net),包含上下文几何注意力(CGA)模块和跨阶段多图共识(CSMGC)模块。CGA通过自适应注意力机制动态融合空间位置与特征信息,增强对局部与全局几何关系的建模能力;CSMGC则通过跨阶段稀疏图网络建立几何共识,保证不同阶段几何信息的一致性。在两个代表性数据集YFCC100M和SUN3D上的实验表明,MGCA-Net在误匹配剔除和相机位姿估计任务中显著优于现有最先进方法。源代码已公开于http://www.linshuyuan.com。
原文摘要 · Abstract (English)
Two-view correspondence learning is a key task in computer vision, which aims to establish reliable matching relationships for applications such as camera pose estimation and 3D reconstruction. However, existing methods have limitations in local geometric modeling and cross-stage information optimization, which make it difficult to accurately capture the geometric constraints of matched pairs and thus reduce the robustness of the model. To address these challenges, we propose a Multi-Graph Contextual Attention Network (MGCA-Net), which consists of a Contextual Geometric Attention (CGA) module and a Cross-Stage Multi-Graph Consensus (CSMGC) module. Specifically, CGA dynamically integrates spatial position and feature information via an adaptive attention mechanism and enhances the capability to capture both local and global geometric relationships. Meanwhile, CSMGC establishes geometric consensus via a cross-stage sparse graph network, ensuring the consistency of geometric information across different stages. Experimental results on two representative YFCC100M and SUN3D datasets show that MGCA-Net significantly outperforms existing SOTA methods in the outlier rejection and camera pose estimation tasks. Source code is available at http://www.linshuyuan.com.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。