发现合成数据训练的超分辨率模型在真实卫星图像上表现大幅下降
Mind the Gap: Quantifying the Domain Gap in Cross-Sensor Diffusion Super-Resolution

- 用真实遥感影像对比合成数据训练的扩散模型性能
- 真实数据上模型性能下降超40%,且真实训练也难优化
- 适合关注遥感图像重建与域适应问题的研究者
高分辨率卫星影像需求推动了超分辨率(SR)技术发展,以弥合如哨兵-2与行星星座等不同传感器间的分辨率差距。由于缺乏真实的高低分辨率配对数据,现有SR模型多基于合成降级数据训练,导致真实跨传感器图像上存在显著域差异。本文首次系统研究该合成到真实域差异对现代扩散模型的影响。利用大规模几何与时间对齐的哨兵-2与行星星座影像数据集,在受控条件下评估五种先进扩散架构。同时引入基于哨兵-2自监督特征的感知度量LPIPS-Sat。结果表明:合成训练模型在真实数据上性能骤降,而真实数据训练模型则面临优化困难,难以适应物理与辐射多样性。这揭示了当前超分辨率方法的关键局限,提示需解耦超分辨率与域适应任务。
原文摘要 · Abstract (English)
Demand for high-resolution satellite imagery has increased interest in super-resolution (SR) to bridge the spatial resolution gap between freely available missions such as Sentinel-2 and commercial systems like PlanetScope. Because no sensor provides true paired low- and high-resolution observations, SR models are usually trained on synthetically degraded data, creating a domain gap on real cross-sensor imagery. In this work, we provide the first systematic study of how this synthetic-to-real mismatch affects the performance of modern diffusion-based SR models. Using a large, geometrically and temporally aligned dataset of Sentinel-2 and PlanetScope imagery, we evaluate five state-of-the-art diffusion architectures under controlled experimental settings. We also introduce LPIPS-Sat, a domain-adapted perceptual metric based on Sentinel-2 self-supervised features. Our results show two persistent challenges: synthetically trained models degrade sharply on real pairs, while models trained on real cross-sensor data exhibit optimisation difficulties and struggle to adapt to the physical and radiometric diversity. These findings highlight a key limitation of current SR and motivate methods that disentangle super-resolution from domain adaptation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。