arXiv:2512.05139cs.CVcs.LG2025-12

用迁移学习+生成模型,从低分辨率卫星图恢复出高分辨率图像。

Spatiotemporal Satellite Image Downscaling with Transfer Encoders and Autoregressive Generative Models

  • 先用U-Net在低分辨率数据上预训练,提取时空特征并冻结参数。
  • 再将特征输入扩散生成模型,实现50km到7km的高精度重建,R2达0.65~0.94。
  • 保留了真实的时空相关性,适合长期环境监测与暴露评估应用。

我们提出一种基于迁移学习的生成式降尺度框架,从粗分辨率输入重建精细分辨率卫星图像。方法结合轻量级U-Net迁移编码器与基于扩散的生成模型:先在长时间序列的粗分辨率数据(NASA MERRA-2,50 km)上预训练U-Net以学习时空表征,冻结其编码器后作为物理有意义的潜在特征,输入更大的降尺度模型。目标域为高分辨率地球系统模型(GEOS-5 Nature Run,G5NR,7 km),研究区域覆盖亚洲大范围,通过划分为两个子区域和四个季节实现计算可处理。利用Wasserstein距离分析领域相似性,确认MERRA-2与G5NR间分布偏移极小,支持参数冻结迁移的安全性。在不同季节与区域划分下,模型表现优异(R² = 0.65 至 0.94),优于确定性U-Net、变分自编码器及先前迁移学习基线。通过半变异函数、自相关/偏自相关函数及滞后误差评估验证,预测图像保持了物理一致的空间变异性与时间自相关性,支持超越G5NR记录的稳定自回归重建。结果表明,增强迁移的扩散模型能为有限训练周期下的长序列粗分辨率图像提供稳健且物理一致的降尺度方案,对提升环境暴露评估与长期环境监测具有重要意义。

原文摘要 · Abstract (English)

We present a transfer-learning generative downscaling framework to reconstruct fine resolution satellite images from coarse scale inputs. Our approach combines a lightweight U-Net transfer encoder with a diffusion-based generative model. The simpler U-Net is first pretrained on a long time series of coarse resolution data to learn spatiotemporal representations; its encoder is then frozen and transferred to a larger downscaling model as physically meaningful latent features. Our application uses NASA's MERRA-2 reanalysis as the low resolution source domain (50 km) and the GEOS-5 Nature Run (G5NR) as the high resolution target (7 km). Our study area included a large area in Asia, which was made computationally tractable by splitting into two subregions and four seasons. We conducted domain similarity analysis using Wasserstein distances confirmed minimal distributional shift between MERRA-2 and G5NR, validating the safety of parameter frozen transfer. Across seasonal regional splits, our model achieved excellent performance (R2 = 0.65 to 0.94), outperforming comparison models including deterministic U-Nets, variational autoencoders, and prior transfer learning baselines. Out of data evaluations using semivariograms, ACF/PACF, and lag-based RMSE/R2 demonstrated that the predicted downscaled images preserved physically consistent spatial variability and temporal autocorrelation, enabling stable autoregressive reconstruction beyond the G5NR record. These results show that transfer enhanced diffusion models provide a robust and physically coherent solution for downscaling a long time series of coarse resolution images with limited training periods. This advancement has significant implications for improving environmental exposure assessment and long term environmental monitoring.

卫星图像降尺度生成模型迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。