arXiv:2410.11848cs.CVcs.LG2024-10被引 9

提出抗噪遥感图像匹配新方法,提升复杂噪声下的匹配精度与鲁棒性。

A Robust Multisource Remote Sensing Image Matching Method Utilizing Attention and Feature Enhancement Against Noise Interference

  • 融合卷积与注意力机制提取高判别力特征
  • 粗到精匹配策略结合二分类去噪网络,提升匹配一致性
  • 在多种噪声场景下表现稳定,适合实际遥感应用

图像匹配是多源遥感图像应用中的基础且关键任务。然而,遥感图像易受各类噪声干扰,如何在噪声图像中实现精确匹配仍是难题。为此,本文提出一种基于注意力与特征增强的鲁棒多源遥感图像匹配方法。第一阶段,结合深度卷积与Transformer注意力机制进行密集特征提取,构建更具判别力和鲁棒性的特征描述子;随后采用粗到精匹配策略实现稠密匹配。第二阶段,引入基于二分类机制的异常点去除网络,通过对应关系加权实现内点与外点的分类,并剔除稠密匹配中的噪声点。最终实现更高效、准确的匹配。通过在多源遥感图像数据集上与当前先进方法对比,在无噪声、加性随机噪声及周期性条纹噪声等不同场景下验证性能。结果表明,所提方法具有更均衡的性能与更强鲁棒性,为解决噪声图像匹配难题提供了有效参考。

原文摘要 · Abstract (English)

Image matching is a fundamental and critical task of multisource remote sensing image applications. However, remote sensing images are susceptible to various noises. Accordingly, how to effectively achieve accurate matching in noise images is a challenging problem. To solve this issue, we propose a robust multisource remote sensing image matching method utilizing attention and feature enhancement against noise interference. In the first stage, we combine deep convolution with the attention mechanism of transformer to perform dense feature extraction, constructing feature descriptors with higher discriminability and robustness. Subsequently, we employ a coarse-to-fine matching strategy to achieve dense matches. In the second stage, we introduce an outlier removal network based on a binary classification mechanism, which can establish effective and geometrically consistent correspondences between images; through weighting for each correspondence, inliers vs. outliers classification are performed, as well as removing outliers from dense matches. Ultimately, we can accomplish more efficient and accurate matches. To validate the performance of the proposed method, we conduct experiments using multisource remote sensing image datasets for comparison with other state-of-the-art methods under different scenarios, including noise-free, additive random noise, and periodic stripe noise. Comparative results indicate that the proposed method has a more well-balanced performance and robustness. The proposed method contributes a valuable reference for solving the difficult problem of noise image matching.

遥感图像图像匹配抗噪注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。