arXiv:2604.10584cs.CV2026-04

提出新方法提升多光谱与高光谱图像融合效果

CoFusion: Multispectral and Hyperspectral Image Fusion via Spectral Coordinate Attention

论文配图:CoFusion: Multispectral and Hyperspectral Image Fusion via Spectral Coordinate Attention
图 1 · 摘自论文原文
  • 构建多尺度架构,显式建模跨尺度与跨模态依赖
  • 在多个数据集上优于现有方法,空间与光谱性能俱佳
  • 适合遥感图像处理、环境监测等需要高精度融合的场景

多光谱与高光谱图像融合(MHIF)旨在通过融合低分辨率高光谱图像(LRHSI)和高分辨率多光谱图像(HRMSI),重建出高分辨率图像。然而,现有方法在建模跨尺度交互和时空协同方面存在局限,难以在提升空间细节与保持光谱保真度之间取得平衡。为此,我们提出CoFusion:一种统一的时空协同融合框架,显式建模跨尺度与跨模态依赖。具体而言,设计了多尺度生成器(MSG),构建三层金字塔结构,有效融合全局语义与局部细节。每个尺度内采用双分支策略:空间坐标感知混合模块(SpaCAM)捕捉多尺度空间上下文,光谱坐标感知混合模块(SpeCAM)通过频率分解与坐标混合增强光谱表示。此外,引入时空交叉融合模块(SSCFM),实现动态跨模态对齐与互补特征融合。在多个基准数据集上的大量实验表明,CoFusion持续优于当前最优方法,在空间重建与光谱一致性方面表现更优。

原文摘要 · Abstract (English)

Multispectral and Hyperspectral Image Fusion (MHIF) aims to reconstruct high-resolution images by integrating low-resolution hyperspectral images (LRHSI) and high-resolution multispectral images (HRMSI). However, existing methods face limitations in modeling cross-scale interactions and spatial-spectral collaboration, making it difficult to achieve an optimal trade-off between spatial detail enhancement and spectral fidelity. To address this challenge, we propose CoFusion: a unified spatial-spectral collaborative fusion framework that explicitly models cross-scale and cross-modal dependencies. Specifically, a Multi-Scale Generator (MSG) is designed to construct a three-level pyramidal architecture, enabling the effective integration of global semantics and local details. Within each scale, a dual-branch strategy is employed: the Spatial Coordinate-Aware Mixing module (SpaCAM) is utilized to capture multi-scale spatial contexts, while the Spectral Coordinate-Aware Mixing module (SpeCAM) enhances spectral representations through frequency decomposition and coordinate mixing. Furthermore, we introduce the Spatial-Spectral Cross-Fusion Module (SSCFM) to perform dynamic cross-modal alignment and complementary feature fusion. Extensive experiments on multiple benchmark datasets demonstrate that CoFusion consistently outperforms state-of-the-art methods, achieving superior performance in both spatial reconstruction and spectral consistency.

图像融合遥感深度学习多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。