arXiv:2502.04623cs.CV2025-02ICML被引 4

用异构图学习融合高光谱与全色图像,提升遥感影像细节还原能力。

HetSSNet: Spatial-Spectral Heterogeneous Graph Learning Network for Panchromatic and Multispectral Images Fusion

  • 构建空间-光谱异构图,显式建模遥感图像关系先验
  • 通过多关系模式聚合,自适应学习统一表示
  • 在多个数据集上超越主流方法,适合遥感图像增强任务

遥感图像超分辨率融合旨在融合全色(PAN)图像与低分辨率多光谱(LR-MS)图像,重建出高分辨率多光谱(HR-MS)图像。现有主流方法如CNN和Transformer将图像视为欧氏空间中等尺寸的像素网格,难以处理具有不规则地物的遥感图像。图结构更具灵活性,但存在两大挑战:1)构建面向空间-光谱关系的定制化图结构;2)通过图结构学习统一的空间-光谱表示。为此,本文提出空间-光谱异构图学习网络(HetSSNet)。首先构建适用于超分辨率融合的异构图结构,明确描述特定关系;然后设计基础关系模式生成模块,从异构图中提取多种关系模式;最后利用关系模式聚合模块,通过自适应重要性学习,协同整合节点间不同关系的局部与全局信息,实现统一表示。大量实验表明,HetSSNet在多个数据集上显著优于现有方法,具备更强泛化能力。

原文摘要 · Abstract (English)

Remote sensing pansharpening aims to reconstruct spatial-spectral properties during the fusion of panchromatic (PAN) images and low-resolution multi-spectral (LR-MS) images, finally generating the high-resolution multi-spectral (HR-MS) images. In the mainstream modeling strategies, i.e., CNN and Transformer, the input images are treated as the equal-sized grid of pixels in the Euclidean space. They have limitations in facing remote sensing images with irregular ground objects. Graph is the more flexible structure, however, there are two major challenges when modeling spatial-spectral properties with graph: \emph{1) constructing the customized graph structure for spatial-spectral relationship priors}; \emph{2) learning the unified spatial-spectral representation through the graph}. To address these challenges, we propose the spatial-spectral heterogeneous graph learning network, named \textbf{HetSSNet}. Specifically, HetSSNet initially constructs the heterogeneous graph structure for pansharpening, which explicitly describes pansharpening-specific relationships. Subsequently, the basic relationship pattern generation module is designed to extract the multiple relationship patterns from the heterogeneous graph. Finally, relationship pattern aggregation module is exploited to collaboratively learn unified spatial-spectral representation across different relationships among nodes with adaptive importance learning from local and global perspectives. Extensive experiments demonstrate the significant superiority and generalization of HetSSNet.

遥感图像图像融合图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。