arXiv:2606.17722cs.CV2026-06

用可学习的高斯原语实现任意尺度的遥感图像融合。

GSPan: A Continuous Gaussian Primitive Representation for Arbitrary-Scale Pansharpening

论文配图:GSPan: A Continuous Gaussian Primitive Representation for Arbitrary-Scale Pansharpening
图 1 · 摘自论文原文
  • 将残差细节表示为连续高斯原语,替代固定网格预测。
  • 在多个数据集上达到当前最优性能,且推理速度显著提升。
  • 适合需要大场景高效融合的遥感应用,如卫星图像处理。

全色-多光谱图像融合旨在通过低分辨率多光谱(LRMS)和全色(PAN)观测生成高分辨率多光谱(HRMS)图像。现有深度学习方法通常采用固定网格预测,难以适应不同尺度。为此,我们提出GSPan,将二维高斯点阵(2D Gaussian Splatting, GS)引入融合任务。该方法不直接预测像素,而是将波段级残差细节表示为连续可学习的2D高斯原语。设计双流分层交互(DSHI)架构,结合空间-光谱交互注意力(SSIA)模块,从互补的PAN与MS观测中估计这些原语。预测的原语被渲染为残差细节场,并注入上采样的多光谱图像。这种连续表示支持在任意目标采样网格上渲染融合图像,无需针对特定尺度重新训练。进一步提出尺度解耦异构推理(SDAI)策略,在低分辨率下估计原语,以目标分辨率渲染融合图像,显著提升大场景融合效率。在QuickBird、GaoFen-2、WorldView-3和WorldView-3-4K数据集上的实验表明,GSPan达到当前最优融合性能。同时,SDAI大幅加速推理,实现了计算效率与融合质量的良好平衡。结果验证了连续高斯残差表示作为灵活且尺度解耦的替代方案的潜力。

原文摘要 · Abstract (English)

Pansharpening aims to generate high-resolution multispectral (HRMS) images by fusing low-resolution multispectral (LRMS) and panchromatic (PAN) observations. Most existing deep learning methods treat pansharpening as fixed-grid prediction, which limits scale adaptation. To address this, we propose GSPan, a framework that introduces 2D Gaussian Splatting (GS) into pansharpening. Instead of directly predicting pixels, GSPan represents band-wise residual details as continuous and learnable 2D Gaussian primitives. We design a Dual-Stream Hierarchical Interaction (DSHI) architecture with a Spatial-Spectral Interactive Attention (SSIA) module to estimate these primitives from complementary PAN and MS observations. The predicted primitives are rendered as a residual detail field and injected into the upsampled MS image. This continuous representation allows GSPan to render fused images on arbitrary target sampling grids without scale-specific retraining. It further enables a Scale-Decoupled Asymmetric Inference (SDAI) strategy, which estimates primitives at a reduced resolution and renders the fused image at the target resolution for efficient large-scene pansharpening. Experiments on QuickBird, GaoFen-2, WorldView-3, and WorldView-3-4K datasets show that GSPan delivers state-of-the-art fusion performance. Moreover, SDAI markedly accelerates inference, achieving a favorable trade-off between computational efficiency and fusion quality. Our results demonstrate the potential of continuous Gaussian residual representations as a flexible and scale-decoupled alternative to fixed-grid prediction.

图像融合遥感高斯点阵尺度自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。