融合雷达与卫星数据,分两阶段预测降水,提升短期预报精度。
VMU-Diff: A Coarse-to-fine Multi-source Data Fusion Framework for Precipitation Nowcasting

- 用雷达+多波段卫星数据输入,分粗粒度预测和细粒度生成两阶段。
- 在江苏SWAN数据集上,短时预报准确率显著优于现有方法。
- 适合需要高精度短期降水预测的气象业务与灾害预警场景。
降水临近预报是气象应用中重要的时空预测任务,但受降水系统混沌特性影响面临挑战。现有方法主要依赖单源雷达数据构建确定性或概率模型进行外推,其中单一确定性模型因MSE收敛导致模糊,而基于扩散模型的概率模型虽可生成细节却产生虚假伪影,且计算效率低。为此,本文提出一种新型的粗到精多源数据融合框架VMU-Diff。该框架通过两阶段实现:第一阶段为基于确定性模型的粗略预测,利用雷达与多波段卫星数据输入,结合时空注意力块和多个Vision Mamba状态空间模块实现多源融合,预测未来回波整体动态;第二阶段为基于残差条件扩散模型的精细化生成,先提取粗预测与真实值之间的时空残差特征,再通过条件Mamba状态空间模块重构残差。在江苏SWAN数据集上的实验表明,该方法在短时预报中显著优于当前最优方法。
原文摘要 · Abstract (English)
Precipitation nowcasting is a vital spatio-temporal prediction task for meteorological applications but faces challenges due to the chaotic property of precipitation systems. Existing methods predominantly rely on single-source radar data to build either deterministic or probabilistic models for extrapolation. However, the single deterministic model suffers from blurring due to MSE convergence. The single probabilistic model, typically represented by diffusion models, can generate fine details but suffers from spurious artifacts that compromise accuracy and computational inefficiency. To address these challenges, this paper proposes a novel coarse-to-fine Vision Mamba Unet and residual Diffusion (VMU-Diff) based precipitation nowcasting framework. It realizes precipitation nowcasting through a two-stage process, i.e., a deterministic model-based coarse stage to predict global motion trends and a probabilistic model-based fine stage to generate fine prediction details. In the coarse prediction stage, rather than single-source radar data, both radar and multi-band satellite data are taken as input. A spatial-temporal attention block and several Vision mamba state-space blocks realize multi-source data fusion, and predict the future echo global dynamics. The fine-grained stage is realized by a spatio-temporal refine generator based on residual conditional diffusion models. It first obtains spatio-temporal residual features based on coarse prediction and ground truth, and further reconstructs the residual via conditional Mamba state-space module. Experiments on Jiangsu SWAN datasets demonstrate the improvements of our method over state-of-the-art methods, particularly in short-term forecasts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。