arXiv:2605.19734cs.CV2026-05

GeoMamba提升遥感光学与SAR图像跨模态细粒度检索性能

GeoMamba: A Geometry-driven MambaVision Framework and Dataset for Fine-grained Optical-SAR Object Retrieval

论文配图:GeoMamba: A Geometry-driven MambaVision Framework and Dataset for Fine-grained Optical-SAR Object Retrieval
图 1 · 摘自论文原文
  • 引入几何特征注入模块,增强跨模态特征交互
  • 在非对齐条件下实现63.3% mAP和77.0% Rank-1准确率
  • 适用于航空航天与海事目标的细粒度检索场景

多源遥感可互补观测地物,但跨模态细粒度检索在光学与SAR数据未对齐时仍具挑战。传统方法依赖配对或空间对齐样本,而实际应用中存在显著模态差异、斑点噪声与结构不一致,制约了鲁棒的跨模态表征学习。为此,我们提出GeoMamba,一种面向光学-SAR细粒度检索的几何驱动框架。具体地,引入几何特征注入(GFI)模块,融合结构先验,增强跨模态特征交互并提升SAR表征鲁棒性;结合几何一致性约束(GCC)模块与深度监督(DS)策略,利用经典算子施加分层几何约束,保留关键物体结构信息。同时构建新数据集FGOS-as,包含11类航空航天与海事目标,用于评估真实遥感场景下的非对齐跨模态细粒度检索。在FGOS-as上的大量实验表明,GeoMamba优于现有方法,在全对全检索设置下达到63.3% mAP与77.0% Rank-1准确率。

原文摘要 · Abstract (English)

Multi-source remote sensing enables complementary observation of ground objects, while cross-modal fine-grained object retrieval remains challenging, especially under unaligned optical and SAR conditions. Unlike conventional retrieval settings that rely on paired or spatially aligned samples, practical optical-SAR retrieval is affected by substantial modality discrepancy, speckle noise, and structural inconsistency, which limit robust cross-modal representation learning. To address this problem, we propose GeoMamba, a geometry-driven framework tailored for optical-SAR fine-grained retrieval. Specifically, GeoMamba introduces a Geometric Feature Injection (GFI) module that enhances cross-modal feature interaction and incorporates structural priors, thereby improving the robustness of SAR representations and promoting geometry-consistent feature learning. In addition, a Geometric Consistency Constraint (GCC) module, together with a Deep Supervision (DS) strategy, imposes hierarchical geometric constraints using classical operators, which helps preserve informative object structures during representation learning. We further construct a new dataset, FGOS-as, containing 11 aerospace and maritime categories for evaluating unaligned cross-modal fine-grained object retrieval in realistic remote sensing scenarios. Extensive experiments on FGOS-as demonstrate that GeoMamba outperforms existing methods, achieving 63.3% mAP and 77.0% Rank-1 accuracy in all-to-all retrieval setting.

遥感跨模态细粒度检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。