arXiv:2510.14962cs.CV2025-10被引 1

提出新型注意力扩散模型,实现精准降水预报且无需额外编码器

RainDiff: End-to-end Precipitation Nowcasting Via Token-wise Attention Diffusion

  • 将逐标记注意力嵌入扩散模型与时空编码器,动态捕捉多尺度时空交互
  • 在多个数据集上超越现有方法,在复杂场景下提升预报精度与鲁棒性
  • 无需潜空间编码器,计算开销更低,适合实时降水预测应用

降水临近预报——从当前雷达回波预测未来回波序列——是一项关键但极具挑战的任务,因大气具有内在混沌性和强耦合的时空动态。尽管基于扩散模型的最新进展尝试捕捉大尺度运动和细粒度随机变化,但通常面临可扩展性问题:潜空间方法需独立训练自编码器,增加复杂性并限制泛化能力;像素空间方法计算成本高,且常省略注意力机制,削弱长程时空依赖建模能力。为此,我们提出在扩散模型的U-Net及时空编码器中集成逐标记注意力,动态捕捉多尺度空间交互与时间演化。不同于以往方法,本方法原生融合注意力机制,无需高昂资源开销,从而消除对独立潜空间模块的需求。在多种数据集上的大量实验与视觉评估表明,所提方法显著优于现有最优方案,在复杂降水预报场景中展现出更优的局部保真度、泛化能力与鲁棒性。

原文摘要 · Abstract (English)

Precipitation nowcasting, predicting future radar echo sequences from current observations, is a critical yet challenging task due to the inherently chaotic and tightly coupled spatio-temporal dynamics of the atmosphere. While recent advances in diffusion-based models attempt to capture both large-scale motion and fine-grained stochastic variability, they often suffer from scalability issues: latent-space approaches require a separately trained autoencoder, adding complexity and limiting generalization, while pixel-space approaches are computationally intensive and often omit attention mechanisms, reducing their ability to model long-range spatio-temporal dependencies. To address these limitations, we propose a Token-wise Attention integrated into not only the U-Net diffusion model but also the spatio-temporal encoder that dynamically captures multi-scale spatial interactions and temporal evolution. Unlike prior approaches, our method natively integrates attention into the architecture without incurring the high resource cost typical of pixel-space diffusion, thereby eliminating the need for separate latent modules. Our extensive experiments and visual evaluations across diverse datasets demonstrate that the proposed method significantly outperforms state-of-the-art approaches, yielding superior local fidelity, generalization, and robustness in complex precipitation forecasting scenarios.

降水预报扩散模型注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。