arXiv:2505.02161cs.CV2025-05

通过置信度引导注意力,提升特征匹配的准确性与鲁棒性。

Not All Pixels Are Equal: Confidence-Guided Attention for Feature Matching

  • 根据匹配置信度动态调整注意力权重,过滤无关区域干扰。
  • 在三个基准上优于现有最优方法,显著减少误匹配。
  • 适合需要高精度特征匹配的应用,如三维重建、视觉定位。

半密集特征匹配方法通过注意力机制提取具有区分性的描述子取得了显著进展。然而,现有方法在注意力计算中对所有像素一视同仁,可能引入来自无关区域的噪声和冗余。为此,本文提出一种置信度引导的注意力机制,基于预计算的匹配置信度图自适应地裁剪每个像素的注意力权重。该置信度图通过骨干网络提取的特征对之间的互相似性评估生成,高置信度表示更高匹配潜力。注意力优化分为两步:(1) 引入置信度引导的偏置,自适应调整查询像素的注意力分布,避免非重叠区域间的无效交互;(2) 在特征聚合时利用对应置信度图重新缩放值特征,抑制不确定区域的影响。此外,引入分类损失,促使骨干网络区分可匹配与不可匹配区域。在三个基准上的大量实验表明,所提方法优于现有最先进方法。

原文摘要 · Abstract (English)

Semi-dense feature matching methods have been significantly advanced by leveraging attention mechanisms to extract discriminative descriptors. However, most existing approaches treat all pixels equally during attention computations, which can potentially introduce noise and redundancy from irrelevant regions. To address this issue, we propose a confidence-guided attention that adaptively prunes attention weights for each pixel based on precomputed matching confidence maps. These maps are generated by evaluating the mutual similarity between feature pairs extracted from the backbone, where high confidence indicates a high potential for matching. Then the attention is refined through two steps: (1) a confidence-guided bias is introduced to adaptively adjust the attention distributions for each query pixel, avoiding irrelevant interactions between non-overlap pixels; (2) the corresponding confidence map is additionally employed to rescale value features during feature aggregation, attenuating the influence of uncertain regions. Moreover, a classification loss is introduced to encourage the backbone's features to discriminate between matchable and non-matchable regions. Extensive experiments on three benchmarks demonstrate that the proposal outperforms existing state-of-the-art methods.

特征匹配注意力机制置信度视觉定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。