arXiv:2609.06343cs.CV2026-09

提出可抵抗辐射、旋转、缩放变化的图像匹配特征描述符

Radiation, Rotation and Scale Invariant Feature Descriptor for Multimodal Image Matching

论文配图:Radiation, Rotation and Scale Invariant Feature Descriptor for Multimodal Image Matching
图 1 · 摘自论文原文
  • 双头区域采样同时进行笛卡尔与对数极坐标采样,提升旋转缩放鲁棒性
  • 在统一特征空间联合编码几何与辐射关系,实现跨模态特征融合
  • 通过双向生成重建约束,无额外开销地学习模态不变拓扑结构

多模态图像匹配是多源信息融合的基础任务。然而,几何畸变和非线性辐射差异(NRD)严重限制性能,尤其在辐射、旋转和缩放变化下。为此,我们提出辐射、旋转、缩放不变(RRSI)特征描述符。首先,双头区域采样(DHRS)模块在关键点邻域同时执行笛卡尔与对数极坐标采样,保留空间结构特性,增强对旋转和缩放变化的鲁棒性。随后,在统一深度特征空间中联合编码多模态图像间的几何与辐射关系,实现模内、双头采样区域及跨模态区域的特征编码、交互与融合。此外,训练阶段引入双向跨模态生成重建约束:通过解码隐式特征生成对应模态的结构块,锚定模态不变的几何拓扑,无需额外推理开销。在光学-红外与光学-SAR数据集上的实验表明,该方法具有优异的匹配性能,对旋转(0至360度)和缩放(最大4倍)变化具有强鲁棒性。其泛化能力在计算机视觉、遥感与医学影像的多模态图像上进一步验证。代码将公开于 https://github.com/yeyuanxin110/RRSI。

原文摘要 · Abstract (English)

Multimodal image matching is a fundamental task for multi-source information fusion. However, geometric distortions and nonlinear radiometric differences (NRD) severely limit performance, especially under radiometric, rotation, and scale variations. To address this issue, we propose a radiation, rotation, and scale invariant (RRSI) feature descriptor. First, a dual-head regional sampling (DHRS) module simultaneously performs Cartesian and Log-Polar sampling on keypoint neighborhoods, retaining spatial structural properties while enhancing robustness to rotation and scale variations. We then jointly encode geometric and radiometric relations between multimodal images in a unified deep feature space, enabling feature encoding, interaction, and fusion across intra-modal, dual-head sampled, and inter-modal regions. Furthermore, we introduce a bidirectional cross-modal generative reconstruction constraint during training. By decoding implicit features into structural patches of the counterpart modality, this mechanism anchors modality-invariant geometric topologies without additional inference overhead. Experiments on optical-infrared and optical-SAR datasets demonstrate highly competitive matching performance and strong robustness to rotation and scale variations. RRSI supports the full rotation range from 0 to 360 degrees and scale factors up to four. Its generalization ability is further validated on multimodal images from computer vision, remote sensing, and medical imaging. The implementation will be made publicly available at https://github.com/yeyuanxin110/RRSI .

图像匹配多模态不变特征遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。