提出几何引导的稠密配准框架,解决光学与SAR图像大变形下的配准难题。
GDROS: A Geometry-Guided Dense Registration Framework for Optical-SAR Images under Large Geometric Transformations
- 融合CNN-Transformer提取跨模态特征,构建多尺度4D相关体积
- 通过最小二乘回归约束光流场,提升大几何变换下配准精度
- 在3个数据集上超越现有方法,适用于多分辨率遥感图像
光学与合成孔径雷达(SAR)遥感图像的配准是图像融合与视觉导航的重要基础。由于模态差异显著,表现为严重的非线性辐射差异(NRD)、几何畸变和噪声变化,在大几何变换下,传统基于模板或稀疏关键点的方法难以取得可靠结果。为此,我们提出GDROS,一种基于几何引导的稠密配准框架,利用全局跨模态交互。首先,通过CNN-Transformer混合模块从光学与SAR图像中提取跨模态深度特征,并构建多尺度4D相关体积,迭代优化以建立像素级稠密对应关系。随后,引入最小二乘回归(LSR)模块,对预测的稠密光流场施加几何约束,通过直接将估计的仿射变换施加于最终光流预测,有效抑制预测发散。在三个代表性数据集WHU-Opt-SAR、OS和UBCv2上进行大量实验,涵盖不同空间分辨率,验证了所提方法在多种成像条件下的鲁棒性能。定性与定量结果表明,GDROS在所有指标上均显著优于当前最先进方法。代码将开源:https://github.com/Zi-Xuan-Sun/GDROS。
原文摘要 · Abstract (English)
Registration of optical and synthetic aperture radar (SAR) remote sensing images serves as a critical foundation for image fusion and visual navigation tasks. This task is particularly challenging because of their modal discrepancy, primarily manifested as severe nonlinear radiometric differences (NRD), geometric distortions, and noise variations. Under large geometric transformations, existing classical template-based and sparse keypoint-based strategies struggle to achieve reliable registration results for optical-SAR image pairs. To address these limitations, we propose GDROS, a geometry-guided dense registration framework leveraging global cross-modal image interactions. First, we extract cross-modal deep features from optical and SAR images through a CNN-Transformer hybrid feature extraction module, upon which a multi-scale 4D correlation volume is constructed and iteratively refined to establish pixel-wise dense correspondences. Subsequently, we implement a least squares regression (LSR) module to geometrically constrain the predicted dense optical flow field. Such geometry guidance mitigates prediction divergence by directly imposing an estimated affine transformation on the final flow predictions. Extensive experiments have been conducted on three representative datasets WHU-Opt-SAR dataset, OS dataset, and UBCv2 dataset with different spatial resolutions, demonstrating robust performance of our proposed method across different imaging resolutions. Qualitative and quantitative results show that GDROS significantly outperforms current state-of-the-art methods in all metrics. Our source code will be released at: https://github.com/Zi-Xuan-Sun/GDROS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。