arXiv:2508.07812cs.CV2025-08

用少量标注+大量无标注数据,实现雷达与光学图像高效匹配。

Semi-supervised Multiscale Matching for SAR-Optical Image

  • 通过伪标签融合深浅层匹配结果,构建无标注图像的伪真值热图。
  • 在公开数据集上达到与全监督顶尖方法相当的匹配精度。
  • 适合缺乏人工标注的遥感图像配准场景,尤其适用于数据稀缺任务。

受光学图像与合成孔径雷达(SAR)图像的互补性驱动,两者间的图像匹配受到广泛关注。现有方法多依赖像素级对应关系的监督信号来提取有效匹配特征,但此类标注耗时且复杂,难以获取足够数量的标注图像对。为此,本文提出一种半监督多尺度匹配框架S2M2-SAR,利用少量标注与大量未标注图像对进行训练。具体地,通过结合深层与浅层匹配结果,为未标注图像对生成伪真值相似性热图,并联合真实与伪标签热图训练匹配模型。此外,引入基于跨模态互独立性损失的跨模态特征增强模块,无需真实标签即可促进共享特征与特有特征的分离,实现光学与SAR模态的有效特征解耦。在基准数据集上的实验表明,S2M2-SAR不仅优于现有半监督方法,且性能接近全监督最先进水平,验证了其高效性与实际应用潜力。

原文摘要 · Abstract (English)

Driven by the complementary nature of optical and synthetic aperture radar (SAR) images, SAR-optical image matching has garnered significant interest. Most existing SAR-optical image matching methods aim to capture effective matching features by employing the supervision of pixel-level matched correspondences within SAR-optical image pairs, which, however, suffers from time-consuming and complex manual annotation, making it difficult to collect sufficient labeled SAR-optical image pairs. To handle this, we design a semi-supervised SAR-optical image matching pipeline that leverages both scarce labeled and abundant unlabeled image pairs and propose a semi-supervised multiscale matching for SAR-optical image matching (S2M2-SAR). Specifically, we pseudo-label those unlabeled SAR-optical image pairs with pseudo ground-truth similarity heatmaps by combining both deep and shallow level matching results, and train the matching model by employing labeled and pseudo-labeled similarity heatmaps. In addition, we introduce a cross-modal feature enhancement module trained using a cross-modality mutual independence loss, which requires no ground-truth labels. This unsupervised objective promotes the separation of modality-shared and modality-specific features by encouraging statistical independence between them, enabling effective feature disentanglement across optical and SAR modalities. To evaluate the effectiveness of S2M2-SAR, we compare it with existing competitors on benchmark datasets. Experimental results demonstrate that S2M2-SAR not only surpasses existing semi-supervised methods but also achieves performance competitive with fully supervised SOTA methods, demonstrating its efficiency and practical potential.

图像匹配半监督遥感多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。