用3D高斯点云生成气象预报,支持任意分辨率灵活放大。
Generative 3D Gaussian Splatting for Arbitrary-ResolutionAtmospheric Downscaling and Forecasting
- 将经纬网格转为3D高斯点,用生成模型预测参数提升泛化能力。
- 在ERA5上准确预报87个大气变量,支持连续分辨率调整。
- 首次结合生成高斯与尺度感知注意力,适合气象高分辨率建模者。
基于人工智能的数值天气预报虽能快速预测,但生成高分辨率输出仍面临计算负担大、多尺度适应性差和数据表示效率低的问题。本文提出一种基于3D高斯点云的尺度感知视觉变换器(GSSA-ViT),实现高维大气场的任意分辨率预报与灵活降尺度。具体地,将经纬度网格点视为3D高斯中心,引入生成式3D高斯预测机制,估计协方差、属性和透明度等关键参数,增强模型泛化能力并缓解过拟合。同时设计尺度感知注意力模块,捕捉跨尺度依赖关系,使模型可有效融合不同降尺度比例的信息,支持连续分辨率自适应。据我们所知,这是首个结合生成式3D高斯建模与尺度感知注意力的统一多尺度气象预测方法。在ERA5数据集上的实验表明,该方法可准确预报87个大气变量于任意分辨率;在ERA5与CMIP6上的降尺度评估也验证了其优越性能。该框架为高分辨率、多尺度大气预测与降尺度提供了高效可扩展的解决方案。代码已开源:https://github.com/binbin2xs/weather-GS。
原文摘要 · Abstract (English)
While AI-based numerical weather prediction (NWP) enables rapid forecasting, generating high-resolution outputs remains computationally demanding due to limited multi-scale adaptability and inefficient data representations. We propose the 3D Gaussian splatting-based scale-aware vision transformer (GSSA-ViT), a novel framework for arbitrary-resolution forecasting and flexible downscaling of high-dimensional atmospheric fields. Specifically, latitude-longitude grid points are treated as centers of 3D Gaussians. A generative 3D Gaussian prediction scheme is introduced to estimate key parameters, including covariance, attributes, and opacity, for unseen samples, improving generalization and mitigating overfitting. In addition, a scale-aware attention module is designed to capture cross-scale dependencies, enabling the model to effectively integrate information across varying downscaling ratios and support continuous resolution adaptation. To our knowledge, this is the first NWP approach that combines generative 3D Gaussian modeling with scale-aware attention for unified multi-scale prediction. Experiments on ERA5 show that the proposed method accurately forecasts 87 atmospheric variables at arbitrary resolutions, while evaluations on ERA5 and CMIP6 demonstrate its superior performance in downscaling tasks. The proposed framework provides an efficient and scalable solution for high-resolution, multi-scale atmospheric prediction and downscaling. Code is available at: https://github.com/binbin2xs/weather-GS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。