用快速核空间扩散模型提升遥感图像融合速度与质量
Fast Kernel-Space Diffusion for Remote Sensing Pansharpening
- 通过低秩张量与统一因子生成器构建带全局上下文的卷积核
- 相比基线方法推理速度提升500倍以上,且保持更优融合效果
- 适合需要高效高质遥感图像融合的应用场景
全色锐化旨在将高分辨率全色(PAN)与低分辨率多光谱(LRMS)图像融合为兼具精细空间细节和丰富光谱信息的单幅图像。尽管基于深度学习的方法取得进展,现有方法常无法捕捉遥感数据分布中的全局先验。扩散模型因强大的分布建模能力成为新方案,但存在推理延迟高的问题。本文提出KSDiff,一种快速核空间扩散框架,通过生成富含全局上下文的卷积核来提升融合质量并加速推理。具体地,KSDiff结合低秩核心张量生成器与统一因子生成器,并由结构感知多头注意力机制协同调度。此外,设计了专用于全色锐化的两阶段训练策略,便于集成至现有架构。实验表明,KSDiff在性能上优于近期先进方法,推理速度较扩散基线快超过500倍。消融实验、可视化及进一步评估验证了该方法的有效性。代码将在接受后公开。
原文摘要 · Abstract (English)
Pansharpening seeks to fuse high-resolution panchromatic (PAN) and low-resolution multispectral (LRMS) images into a single image with both fine spatial and rich spectral detail. Despite progress in deep learning-based approaches, existing methods often fail to capture global priors inherent in remote sensing data distributions. Diffusion-based models have recently emerged as promising solutions due to their powerful distribution mapping capabilities, however, they suffer from heavy inference latency. We introduce KSDiff, a fast kernel-space diffusion framework that generates convolutional kernels enriched with global context to enhance pansharpening quality and accelerate inference. Specifically, KSDiff constructs these kernels through the integration of a low-rank core tensor generator and a unified factor generator, orchestrated by a structure-aware multi-head attention mechanism. We further introduce a two-stage training strategy tailored for pansharpening, facilitating integration into existing pansharpening architectures. Experiments show that KSDiff achieves superior performance compared to recent promising methods, and with over $500 \times$ faster inference than diffusion-based pansharpening baselines. Ablation studies, visualizations and further evaluations substantiate the effectiveness of our approach. Code will be released upon possible acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。