arXiv:2409.00244cs.MScs.LG2024-09被引 14

用深度学习提升复杂系统数据同化,实现高效精准预测。

TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functions

  • 将深度神经网络作为状态转移和观测模型嵌入同化框架
  • 在洛伦兹63和浅水模型上性能显著优于独立模型预测
  • 支持多种同化算法,适用于多物理量空间映射任务

数据同化技术在处理复杂高维物理系统时面临挑战,因高精度模拟计算成本高昂,且难以获取精确的观测函数。这促使人们将深度学习模型引入数据同化流程,但现有软件包无法支持深度学习模型的集成。本文提出新型Python工具TorchDA,无缝结合数据同化与深度神经网络,用于构建状态转移和观测函数。该工具实现卡尔曼滤波、集合卡尔曼滤波(EnKF)、三维变分(3DVar)和四维变分(4DVar)算法,可根据需求灵活选择。在洛伦兹63系统和二维浅水系统上的综合实验表明,同化后性能显著优于无同化的模型预测。浅水系统分析验证了其在全空间或降阶空间中跨物理量空间映射的能力。整体而言,TorchDA为跨科学领域的复杂高维动力系统提供了灵活集成深度学习表示的通用工具。

原文摘要 · Abstract (English)

Data assimilation techniques are often confronted with challenges handling complex high dimensional physical systems, because high precision simulation in complex high dimensional physical systems is computationally expensive and the exact observation functions that can be applied in these systems are difficult to obtain. It prompts growing interest in integrating deep learning models within data assimilation workflows, but current software packages for data assimilation cannot handle deep learning models inside. This study presents a novel Python package seamlessly combining data assimilation with deep neural networks to serve as models for state transition and observation functions. The package, named TorchDA, implements Kalman Filter, Ensemble Kalman Filter (EnKF), 3D Variational (3DVar), and 4D Variational (4DVar) algorithms, allowing flexible algorithm selection based on application requirements. Comprehensive experiments conducted on the Lorenz 63 and a two-dimensional shallow water system demonstrate significantly enhanced performance over standalone model predictions without assimilation. The shallow water analysis validates data assimilation capabilities mapping between different physical quantity spaces in either full space or reduced order space. Overall, this innovative software package enables flexible integration of deep learning representations within data assimilation, conferring a versatile tool to tackle complex high dimensional dynamical systems across scientific domains.

数据同化深度学习科学计算动态系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。