用多模态模型同时预测微分方程解并生成科学描述,提升可解释性。
A Multimodal PDE Foundation Model for Prediction and Scientific Text Descriptions
- 融合数值参数与文本描述,用Transformer统一建模多种微分方程
- 对分布内/外数据预测误差低于3.3%和7.8%,文本生成准确率100%
- 适合需要可解释性输出的科学计算场景,如物理建模与教育应用
神经网络可用于近似科学计算中非线性微分方程的求解,如代理建模、实时预测与最优控制。现有微分方程基础模型主要学习通用解算子或控制方程,仅处理数值或符号模态。但真实场景常需更灵活的输入,如文本分析或描述性输出。为此,我们提出一种基于Transformer的多模态深度学习方法,可同时近似多种常微分方程(ODE)与偏微分方程(PDE)的解算子。该方法整合方程参数、初值等数值输入,以及物理过程或系统动态的文本描述,适用于符号表示不完整或缺失的场景。不仅能提供高精度数值解,还可生成可解释的科学文本描述,揭示解的内在动态特性。实验表明,模型在分布内数据上平均相对误差低于3.3%,分布外数据低于7.8%,且文本描述生成准确率达100%;部分测试中还展现出时间外推能力。
原文摘要 · Abstract (English)
Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to train approximations to multiple differential equations simultaneously and are thus a general purpose solver that can be adapted to downstream tasks. Current PDE foundation models focus on either learning general solution operators and/or the governing system of equations, and thus only handle numerical or symbolic modalities. However, real-world applications may require more flexible data modalities, e.g. text analysis or descriptive outputs. To address this gap, we propose a novel multimodal deep learning approach that leverages a transformer-based architecture to approximate solution operators for a wide variety of ODEs and PDEs. Our method integrates numerical inputs, such as equation parameters and initial conditions, with text descriptions of physical processes or system dynamics. This enables our model to handle settings where symbolic representations may be incomplete or unavailable. In addition to providing accurate numerical predictions, our approach generates interpretable scientific text descriptions, offering deeper insights into the underlying dynamics and solution properties. The numerical experiments show that our model provides accurate solutions for in-distribution data (with average relative error less than 3.3%) and out-of-distribution data (average relative error less than 7.8%) together with precise text descriptions (with correct descriptions generated 100% of times). In certain tests, the model is also shown to be capable of extrapolating solutions in time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。