arXiv:2410.22710cs.CV2024-10被引 4

提出轻量级注意力机制,提升图像局部特征匹配精度与速度

LoFLAT: Local Feature Matching using Focused Linear Attention Transformer

  • 用聚焦线性注意力替代传统注意力,降低计算开销
  • 在多个数据集上匹配准确率超越LoFTR,且推理更快
  • 适合需要高精度实时匹配的视觉任务

局部特征匹配是图像匹配中的关键技术,在众多基于视觉的应用中起着关键作用。然而,现有的基于Transformer的无检测器局部特征匹配方法因注意力机制的二次计算复杂度,在高分辨率下面临挑战。尽管已有方法通过线性注意力降低了计算成本,但仍难以捕捉精细的局部交互,影响了精确对应关系的准确性与鲁棒性。为此,本文提出一种新型局部特征匹配方法LoFLAT,包含特征提取、特征变换和匹配三个模块。特征提取模块使用ResNet和特征金字塔网络获取分层特征;特征变换模块引入聚焦线性注意力,通过聚焦映射函数优化注意力分布,并结合深度可分离卷积增强特征多样性;匹配模块采用粗到精策略生成精确且鲁棒的匹配结果。大量实验表明,所提LoFLAT在效率和准确率上均优于LoFTR。

原文摘要 · Abstract (English)

Local feature matching is an essential technique in image matching and plays a critical role in a wide range of vision-based applications. However, existing Transformer-based detector-free local feature matching methods encounter challenges due to the quadratic computational complexity of attention mechanisms, especially at high resolutions. However, while existing Transformer-based detector-free local feature matching methods have reduced computational costs using linear attention mechanisms, they still struggle to capture detailed local interactions, which affects the accuracy and robustness of precise local correspondences. In order to enhance representations of attention mechanisms while preserving low computational complexity, we propose the LoFLAT, a novel Local Feature matching using Focused Linear Attention Transformer in this paper. Our LoFLAT consists of three main modules: the Feature Extraction Module, the Feature Transformer Module, and the Matching Module. Specifically, the Feature Extraction Module firstly uses ResNet and a Feature Pyramid Network to extract hierarchical features. The Feature Transformer Module further employs the Focused Linear Attention to refine attention distribution with a focused mapping function and to enhance feature diversity with a depth-wise convolution. Finally, the Matching Module predicts accurate and robust matches through a coarse-to-fine strategy. Extensive experimental evaluations demonstrate that the proposed LoFLAT outperforms the LoFTR method in terms of both efficiency and accuracy.

特征匹配Transformer注意力机制图像对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。