通过双向时间对齐提升气候数据超分辨率效果
Temporal Bridges for Spatial Resolution: Enhancing Climate Data Super-Resolution with Bidirectional Alignment

- 构建双向时间桥梁,捕捉不同时间帧间的隐含关联
- 在真实大规模数据集上实现优于现有方法的超分辨率性能
- 适合气候建模、气象预测等需要高分辨率数据的研究者
高分辨率气候数据对气象预测和多领域决策支持至关重要,但获取成本高昂,需依赖数据驱动的气象预测模型。这些模型旨在从低分辨率输入生成精细气候数据,即气候数据超分辨率(SR)。然而,当前深度学习方法主要依赖单帧空间信息,忽视了时间帧间的潜在关联。此外,气候数据具有固有的随机性和噪声,导致传统时间对齐方法(如光流)失效。为此,我们提出一种新型时序增强框架,通过双向时间对齐建立时间桥梁,以提升气候数据超分辨率性能。该框架包含:配对潜空间映射(Paired Latent Mapping),用于统一潜空间并实现空间对齐与降噪;双向时间对齐模块,通过前后向网络训练连续潜空间帧以捕捉时间相关性;最终通过时序增强超分辨率优化整体框架。在大规模真实世界数据集上的实验表明,本框架显著优于现有方法。
原文摘要 · Abstract (English)
High-resolution climate data is crucial for meteorological predictions and for informing decision support across diverse domains. However, the acquisition of such high-resolution climate information is often prohibitively costly, necessitating the development of data-driven meteorological prediction models. These models aim to generate fine-grained climate data from low-resolution inputs, a process termed climate data super-resolution (SR). Nevertheless, recent advancements in deep learning for climate data SR have primarily focused on leveraging single-frame spatial information, largely neglecting the temporal correlations between different time frames that could enhance SR outcomes. Furthermore, climate data are inherently stochastic and noisy, rendering widely used temporal alignment methods, such as optical flow models, ineffective in this context. Consequently, the development of a framework tailored for climate data SR that effectively captures implicit temporal correlations remains an unresolved challenge. To this end, we propose a novel Temporal-Enhanced framework with bidirectional temporal alignment. In essence, our framework establishes a temporal bridge to enhance spatial resolution in climate data SR through bidirectional alignment, leading to improved SR performance. Within this framework, Paired Latent Mapping achieves spatial alignment and noise reduction by unifying latent spaces. Then a Bidirectional Temporal Alignment captures temporal correlations by training forward and backward networks on consecutive latent frames. Temporal Enhanced Super-resolution then optimizes the entire framework for climate data SR. Experiments on large-scale real-world datasets demonstrated the superior performance of our framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。