arXiv:2606.24263cs.CVcs.LG2026-06

用生成模型融合多源卫星数据,填补热带气旋观测空档。

MotifGen: Spatiotemporal interpolation of misaligned satellite images via multi-source generative modeling, in an application to tropical cyclones

论文配图:MotifGen: Spatiotemporal interpolation of misaligned satellite images via multi-source generative modeling, in an application to tropical cyclones
图 1 · 摘自论文原文
  • 设计可处理异源、错位、不定时数据的生成模型
  • 自监督训练使预报评分降低,红外+微波融合更优
  • 生成结果接近真实数据功率谱,适合气象监测应用

微波卫星影像对全球热带气旋降水与强度监测至关重要,但因重访周期长,可能错过快速演变阶段。现有插值方法受限于不同仪器间数据高度异质性。本文提出首个能处理多源地理错位、时间不规则、仪器特性各异数据的生成模型。应用于热带气旋微波图像的时空插值,利用自监督任务(随机掩码源并重建)训练,显著降低连续概率评分。结合红外与微波数据进一步提升性能。生成集合均值媲美确定性模型,且功率谱更接近真实观测。据我们所知,这是首个在不规则时间间隔下融合多微波仪器与红外观测实现气旋微波图像插值的生成模型。

原文摘要 · Abstract (English)

Microwave satellite imagery plays a crucial role in monitoring tropical cyclone precipitation and intensity worldwide, but suffers from long revisit times, potentially missing rapid storm evolution phases. While this raises the need for an interpolation method, it is made challenging by the high level of heterogeneity of microwave data coming from different instruments. In this work, we introduce the first generative model that can be applied to multiple geospatial sources that change across samples, occur at irregular time intervals, are misaligned geographically, and come from instruments with varying characteristics. We apply this model to the case of spatio-temporal interpolation of tropical cyclone microwave images from other microwave and infrared instruments. We train using a self-supervised task in which a random source is masked and reconstructed, and show that it leads to a significant decrease in Continuous Ranked Probability Score over supervised training. We show a further improvement by combining infrared and microwave data compared to microwave only. Using these improvements, the generative model produces an ensemble mean on par with that of a deterministic model, while generating a power spectrum significantly closer to that of true observations. To the best of our knowledge, this is the first generative model that interpolates microwave images of cyclones by combining multiple microwave instruments and infrared observations at irregular time intervals.

生成模型气象监测卫星遥感时空插值

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。