arXiv:2507.04233eess.IVcs.CV2025-07

无需检测器,用网格化特征匹配实现大规模遥感图像精准配准

Grid-Reg: Detector-Free Gridized Feature Learning and Matching for Large-Scale SAR-Optical Image Registration

  • 采用网格化特征提取与双分支相关性学习,提升跨模态匹配鲁棒性
  • 通过渐进式双循环搜索,全局优化图像间变换参数估计精度
  • 针对真实无人机数据构建新基准,适合遥感图像配准研究者参考

大尺度异源合成孔径雷达(SAR)与光学图像的配准极具挑战,尤其在不同平台间存在显著几何、辐射和时相差异。为此,提出Grid-Reg框架,包含域鲁棒特征提取网络、基于等角单位基向量的混合孪生相关性学习网络(HSCMLNet)以及基于网格的变换参数求解器(Grid-Solver)。HSCMLNet结合混合孪生模块与相关性度量学习模块(CMLModule),并引入流形一致性损失,实现模态不变且具有区分性的特征学习。Grid-Solver通过渐进式双循环搜索策略最小化全局网格匹配损失,可靠地在整幅图像中寻找对应关系。此外,构建了基于真实无人机MiniSAR数据与Google Earth光学影像的挑战性基准数据集。大量实验表明,该方法显著优于现有先进方法。

原文摘要 · Abstract (English)

It is highly challenging to register large-scale, heterogeneous SAR and optical images, particularly across platforms, due to significant geometric, radiometric, and temporal differences, which most existing methods struggle to address. To overcome these challenges, we propose Grid-Reg, a grid-based multimodal registration framework comprising a domain-robust descriptor extraction network, Hybrid Siamese Correlation Metric Learning Network (HSCMLNet), and a grid-based solver (Grid-Solver) for transformation parameter estimation. In heterogeneous imagery with large modality gaps and geometric differences, obtaining accurate correspondences is inherently difficult. To robustly measure similarity between gridded patches, HSCMLNet integrates a hybrid Siamese module with a correlation metric learning module (CMLModule) based on equiangular unit basis vectors (EUBVs), together with a manifold consistency loss to promote modality-invariant, discriminative feature learning. The Grid-Solver estimates transformation parameters by minimizing a global grid matching loss through a progressive dual-loop search strategy to reliably find patch correspondences across entire images. Furthermore, we curate a challenging benchmark dataset for SAR-to-optical registration using real-world UAV MiniSAR data and Google Earth optical imagery. Extensive experiments demonstrate that our proposed approach achieves superior performance over state-of-the-art methods.

图像配准遥感多模态学习SAR光学融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。