arXiv:2501.13312cs.LG2025-01ICML被引 4

用张量方法让复杂天气模型计算快10-20倍,还更准。

Tensor-Var: Efficient Four-Dimensional Variational Data Assimilation

  • 用核嵌入将非线性系统转为线性优化,避免传统方法的收敛难题。
  • 在混沌系统和真实气象数据上,精度高于传统方法,速度提升10至20倍。
  • 适合需要快速高精度预报的气象、气候等实时预测场景。

变分数据同化通过最小化成本函数来估计动态系统状态,使其与数值模型和观测数据一致。尽管四维变分同化(4D-Var)广泛应用,但在复杂非线性系统中仍面临高计算成本,且依赖不完善的态-观测映射关系。深度学习(DL)提供更强的近似能力,但将其融入4D-Var因非线性与缺乏理论保障而困难。本文提出Tensor-Var框架,结合核条件均值嵌入(CME)与4D-Var,将非线性动力学线性化,在学习特征空间实现凸优化,并提供原始空间与特征空间间同化结果一致性的理论保证。针对大规模问题,我们在框架内引入神经网络学习深层特征。在混沌系统及含实时观测的全球天气预测实验中,Tensor-Var在精度上优于传统及混合深度学习4D-Var基线,同时实现10至20倍的速度提升。

原文摘要 · Abstract (English)

Variational data assimilation estimates the dynamical system states by minimizing a cost function that fits the numerical models with the observational data. Although four-dimensional variational assimilation (4D-Var) is widely used, it faces high computational costs in complex nonlinear systems and depends on imperfect state-observation mappings. Deep learning (DL) offers more expressive approximators, while integrating DL models into 4D-Var is challenging due to their nonlinearities and lack of theoretical guarantees in assimilation results. In this paper, we propose Tensor-Var, a novel framework that integrates kernel conditional mean embedding (CME) with 4D-Var to linearize nonlinear dynamics, achieving convex optimization in a learned feature space. Moreover, our method provides a new perspective for solving 4D-Var in a linear way, offering theoretical guarantees of consistent assimilation results between the original and feature spaces. To handle large-scale problems, we propose a method to learn deep features using neural networks within the Tensor-Var framework. Experiments on chaotic systems and global weather prediction with real-time observations show that Tensor-Var outperforms conventional and DL hybrid 4D-Var baselines in accuracy while achieving a 10- to 20-fold speed improvement.

数据同化深度学习气象预测优化加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。