arXiv:2506.23566cs.CVcs.LG2025-06被引 2

融合元数据与小波变换的扩散模型,提升卫星图像超分辨率效果

Metadata, Wavelet, and Time Aware Diffusion Models for Satellite Image Super Resolution

  • 引入多模态编码器,融合元数据、小波频域信息与时间关系
  • 在多个数据集上超越现有方法,FID与LPIPS指标更优
  • 适合遥感分析、灾害监测等需要高精度卫星图像的场景

高分辨率卫星影像获取常受限于传感器的空间与时间约束,以及频繁观测带来的高昂成本,制约了环境监测、灾害响应和农业管理等应用。本文提出MWT-Diff框架,结合潜在扩散模型与小波变换,解决该问题。核心是新型元数据-小波-时间感知编码器(MWT-Encoder),生成融合元数据属性、多尺度频率信息与时间关系的嵌入表示。这些嵌入引导分层扩散过程,从低分辨率输入逐步重建高分辨率影像,有效保留纹理模式、边界不连续性及高频光谱成分等关键空间特征。在多个数据集上的对比实验表明,该方法在标准感知质量指标(如FID和LPIPS)上优于近期方法。代码已开源。

原文摘要 · Abstract (English)

The acquisition of high-resolution satellite imagery is often constrained by the spatial and temporal limitations of satellite sensors, as well as the high costs associated with frequent observations. These challenges hinder applications such as environmental monitoring, disaster response, and agricultural management, which require fine-grained and high-resolution data. In this paper, we propose MWT-Diff, an innovative framework for satellite image super-resolution (SR) that combines latent diffusion models with wavelet transforms to address these challenges. At the core of the framework is a novel metadata-, wavelet-, and time-aware encoder (MWT-Encoder), which generates embeddings that capture metadata attributes, multi-scale frequency information, and temporal relationships. The embedded feature representations steer the hierarchical diffusion dynamics, through which the model progressively reconstructs high-resolution satellite imagery from low-resolution inputs. This process preserves critical spatial characteristics including textural patterns, boundary discontinuities, and high-frequency spectral components essential for detailed remote sensing analysis. The comparative analysis of MWT-Diff across multiple datasets demonstrated favorable performance compared to recent approaches, as measured by standard perceptual quality metrics including FID and LPIPS. The code is available at https://github.com/LuigiSigillo/MWT-Diff

卫星图像超分辨率扩散模型小波变换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。