arXiv:2602.12515cs.CV2026-02

将光学与SAR图像转为共享模态,实现高精度跨模态配准。

Matching of SAR and optical images based on transformation to shared modality

  • 通过转换到统一模态,使光学与SAR图像具备可比性。
  • 在MultiSenGE数据集上优于现有图像翻译与特征匹配方法。
  • 兼容预训练模型,无需重新训练即可实现高质量配准。

光学图像与合成孔径雷达(SAR)图像因成像物理原理差异显著,导致二者精确配准困难。本文提出一种新方法:将两类图像变换至一个共同的新型模态,该模态满足三条件:一是变换后图像通道数相同;二是变换并配准后的图像尽可能相似;三是非退化,即保留原始图像关键特征。为在该共享模态下进行图像匹配,我们训练了先进的RoMa图像匹配模型,该模型原本用于常规数字照片匹配。在公开数据集MultiSenGE上评估表明,该方法优于基于模态间图像转换及多种特征匹配算法的方案。新方法不仅提升配准质量,且更具通用性,可直接使用为常规图像预训练的RoMa和DeDoDe模型,无需针对新模态重新训练,同时保持高精度的光学与SAR图像配准效果。

原文摘要 · Abstract (English)

Significant differences in optical images and Synthetic Aperture Radar (SAR) images are caused by fundamental differences in the physical principles underlying their acquisition by Earth remote sensing platforms. These differences make precise image matching (co-registration) of these two types of images difficult. In this paper, we propose a new approach to image matching of optical and SAR images, which is based on transforming the images to a new modality. The new image modality is common to both optical and SAR images and satisfies the following conditions. First, the transformed images must have an equal pre-defined number of channels. Second, the transformed and co-registered images must be as similar as possible. Third, the transformed images must be non-degenerate, meaning they must preserve the significant features of the original images. To further match images transformed to this shared modality, we train the RoMa image matching model, which is one of the leading solutions for matching of regular digital photographs. We evaluated the proposed approach on the publicly available MultiSenGE dataset containing both optical and SAR images. We demonstrated its superiority over alternative approaches based on image translation between original modalities and various feature matching algorithms. The proposed solution not only provides better quality of matching, but is also more versatile. It enables the use of ready-made RoMa and DeDoDe models, pre-trained for regular images, without retraining for a new modality, while maintaining high-quality matching of optical and SAR images.

图像配准跨模态SAR共享模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。