arXiv:2511.13168cs.CVcs.AI2025-11AAAI

通过增强特征梯度提升雷达与光学图像配准精度

SOMA: Feature Gradient Enhanced Affine-Flow Matching for SAR-Optical Registration

  • 引入梯度增强模块,融合多尺度梯度信息提升特征区分度
  • 在SEN1-2和GFGE_SO数据集上像素级配准准确率分别提升12.29%和18.50%
  • 适合需要高精度跨模态图像配准的遥感应用

由于合成孔径雷达(SAR)与光学图像成像机制和视觉特征的根本差异,实现二者像素级配准仍具挑战。尽管深度学习在诸多跨模态任务中表现优异,但在SAR-光学图像配准上的性能仍不理想。传统手工描述子依赖梯度信息突出结构差异,但深度学习框架尚未有效利用此类梯度线索。为此,本文提出SOMA,一种将结构梯度先验嵌入深度特征并采用混合匹配策略精修对齐的密集配准框架。具体而言,设计特征梯度增强器(FGE),通过注意力与重构机制将多尺度、多方向梯度滤波器融入特征空间,提升特征独特性。同时提出全局-局部仿射-光流匹配器(GLAM),在粗到细架构中结合仿射变换与基于流的精修,兼顾整体一致性与局部精度。实验表明,SOMA显著提升配准精度,在SEN1-2数据集上CMR@1px提升12.29%,在GFGE_SO数据集上提升18.50%。此外,SOMA具备强鲁棒性,可良好泛化至多种场景与分辨率。

原文摘要 · Abstract (English)

Achieving pixel-level registration between SAR and optical images remains a challenging task due to their fundamentally different imaging mechanisms and visual characteristics. Although deep learning has achieved great success in many cross-modal tasks, its performance on SAR-Optical registration tasks is still unsatisfactory. Gradient-based information has traditionally played a crucial role in handcrafted descriptors by highlighting structural differences. However, such gradient cues have not been effectively leveraged in deep learning frameworks for SAR-Optical image matching. To address this gap, we propose SOMA, a dense registration framework that integrates structural gradient priors into deep features and refines alignment through a hybrid matching strategy. Specifically, we introduce the Feature Gradient Enhancer (FGE), which embeds multi-scale, multi-directional gradient filters into the feature space using attention and reconstruction mechanisms to boost feature distinctiveness. Furthermore, we propose the Global-Local Affine-Flow Matcher (GLAM), which combines affine transformation and flow-based refinement within a coarse-to-fine architecture to ensure both structural consistency and local accuracy. Experimental results demonstrate that SOMA significantly improves registration precision, increasing the CMR@1px by 12.29% on the SEN1-2 dataset and 18.50% on the GFGE_SO dataset. In addition, SOMA exhibits strong robustness and generalizes well across diverse scenes and resolutions.

图像配准遥感深度学习SAR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。