arXiv:2606.04493cs.CVcs.AI2026-06

用频域信息增强Mamba模型,更好区分匹配点中的真伪特征。

SFMambaNet: Spectral-Frequency Enhanced Selective State Space Model for Correspondence Pruning

论文配图:SFMambaNet: Spectral-Frequency Enhanced Selective State Space Model for Correspondence Pruning
图 1 · 摘自论文原文
  • 引入频域感知机制,通过谱位置编码捕捉细微几何一致性。
  • 设计频率门控模块,抑制高频噪声在状态空间的累积。
  • 在多个挑战任务上超越现有方法,适合视觉匹配与三维重建场景。

对应点剪枝旨在从初始对应关系中识别内点。现有基于图神经网络(GNN)的方法依赖粗略欧氏坐标映射的几何特征,难以捕捉内点呈现的细微几何一致性。而基于Mamba的方法虽具备全局感受野和长序列建模能力,却容易在隐藏状态空间中累积大量不一致特征,导致内点与外点区分困难。本文首次将频域感知引入该任务,提出SFMambaNet:一种基于Mamba的两视图对应点剪枝网络。方法由两个组件构成:首先设计局部谱-几何注意力(LSGA)块,将谱位置编码融入局部图交互,并引入多尺度Mamba处理,以增强对细微几何一致性的捕捉并提升局部特征判别力;其次设计谱融合全局Mamba(SIGM)块,在状态空间中嵌入频率门控机制,利用LSGA提供的频域信息显式抑制隐藏状态中的高频噪声积累,缓解不一致特征传播。该设计提升了内点与外点的可分性,实现近线性复杂度下的鲁棒全局上下文建模。大量实验表明,SFMambaNet在多个挑战性任务上优于当前最优方法。代码已开源:https://github.com/Kirito14IT/SFMambaNet。

原文摘要 · Abstract (English)

Correspondence pruning aims to identify inliers from an initial set of correspondences. Most existing Graph Neural Network (GNN)-based methods rely on geometric features mapped from coarse Euclidean coordinates, which struggle to capture the subtle geometric consistencies presented by inliers. While Mamba-based methods possess global receptive fields and long sequence modeling capabilities, they tend to accumulate substantial inconsistent features within the hidden state space, making it difficult to distinguish inliers from outliers. In this paper, we integrate frequency domain perception into this task for the first time and propose SFMambaNet, a novel Spectral-Frequency enhanced Mamba-based two-view correspondence pruning network. Our method is collaboratively composed of two components: First, we design a Local Spectral-Geometric Attention (LSGA) block. LSGA incorporates spectral positional encoding into local graph interactions and introduces multi-scale Mamba processing to enhance the capture of subtle geometric consistencies and improve local feature discriminability. Building upon this, we design a Spectral-Integrated Global Mamba (SIGM) block. SIGM embeds a frequency gating mechanism within the state space, utilizing the frequency information provided by LSGA to explicitly suppress high-frequency noise accumulation within hidden states and mitigate the propagation of inconsistent features. This enhances inlier-outlier separability and achieves robust global context modeling capabilities with nearly linear complexity. Extensive experiments demonstrate that SFMambaNet outperforms current state-of-the-art methods on several challenging tasks. The code is available at https://github.com/Kirito14IT/SFMambaNet.

对应点剪枝Mamba频域感知几何一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。