arXiv:2510.07905eess.IVcs.CV2025-10

融合多帧与多源影像,提升遥感图像质量

SatFusion: A Unified Framework for Enhancing Remote Sensing Images via Multi-Frame and Multi-Source Images Fusion

  • 统一框架整合多帧与多源信息,增强细节恢复
  • 在四个数据集上实现更优重建精度与鲁棒性
  • 适合遥感图像处理与高分辨率成像研究者

高质量遥感图像获取受物理条件限制。多帧超分辨(MFSR)和全色锐化虽能利用互补信息,但通常孤立研究:MFSR缺乏高分辨率结构先验,难恢复精细纹理;全色锐化依赖上采样的低分辨率输入,对噪声和配准误差敏感。本文提出SatFusion,一个统一框架,无缝融合多帧与多源遥感图像。通过多帧图像融合(MFIF)模块聚合多帧低分辨率多光谱图像的互补信息,提取高分辨率语义特征;并通过多源图像融合(MSIF)模块,隐式对齐像素级细节,引入高分辨率全色图像中的精细结构。为缓解多帧融合中结构先验不足问题,提出改进版SatFusion*,在MFIF阶段引入全色引导机制。结合结构感知特征嵌入与基于Transformer的自适应聚合,实现空间自适应特征选择,强化多帧与多源表示间的耦合。在四个基准数据集上的大量实验验证了核心观点:协同利用多帧与多源先验可有效克服现有方法脆弱性,显著提升重建保真度、鲁棒性与泛化能力。

原文摘要 · Abstract (English)

High-quality remote sensing (RS) image acquisition is fundamentally constrained by physical limitations. While Multi-Frame Super-Resolution (MFSR) and Pansharpening address this by exploiting complementary information, they are typically studied in isolation: MFSR lacks high-resolution (HR) structural priors for fine-grained texture recovery, whereas Pansharpening relies on upsampled low-resolution (LR) inputs and is sensitive to noise and misalignment. In this paper, we propose SatFusion, a novel and unified framework that seamlessly bridges multi-frame and multi-source RS image fusion. SatFusion extracts HR semantic features by aggregating complementary information from multiple LR multispectral frames via a Multi-Frame Image Fusion (MFIF) module, and integrates fine-grained structural details from an HR panchromatic image through a Multi-Source Image Fusion (MSIF) module with implicit pixel-level alignment. To further alleviate the lack of structural priors during multi-frame fusion, we introduce an advanced variant, SatFusion*, which integrates a panchromatic-guided mechanism into the MFIF stage. Through structure-aware feature embedding and transformer-based adaptive aggregation, SatFusion* enables spatially adaptive feature selection, strengthening the coupling between multi-frame and multi-source representations. Extensive experiments on four benchmark datasets validate our core insight: synergistically coupling multi-frame and multi-source priors effectively resolves the fragility of existing paradigms, delivering superior reconstruction fidelity, robustness, and generalizability.

遥感图像图像融合超分辨多源数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。