用物理方程指导训练,让模型少依赖数据也能精准解偏微分方程。
PI-MFM: Physics-informed multimodal foundation model for solving partial differential equations
- 输入方程符号表达式,自动生成残差损失,直接融入训练过程。
- 在稀疏数据下仍保持高精度,噪声鲁棒性更强,零样本迁移误差低于1%。
- 适合需要快速适应新方程的科研与工程场景,尤其数据稀缺时。
偏微分方程(PDE)描述了广泛的物理系统,近期多模态基础模型在跨方程族学习解算子方面展现出潜力。然而,现有方法依赖大量数据,且训练中忽略物理规律。本文提出物理信息多模态基础模型(PI-MFM),在预训练与微调阶段直接施加控制方程。PI-MFM以PDE的符号表达为输入,通过向量化微分计算自动生成PDE残差损失。该设计使任意基于编码的多模态模型均能统一使用物理约束进行训练或适配。在包含13类一维时变参数化PDE的基准测试中,PI-MFM持续优于纯数据驱动方法,尤其在标签点稀疏、时间域部分观测或少量函数对的情况下表现突出。物理损失进一步提升抗噪能力,简单重采样策略显著提高精度。我们还分析了自动微分与有限差分在导数计算中的精度、准确率与计算成本。最终,通过零样本物理信息微调,仅用方程残差与初/边界条件即可实现对未见方程族的快速适配,测试误差迅速降至约1%,明显优于从零开始的纯物理训练。结果表明,PI-MFM为高效、可迁移的PDE求解提供了实用且可扩展的路径。
原文摘要 · Abstract (English)
Partial differential equations (PDEs) govern a wide range of physical systems, and recent multimodal foundation models have shown promise for learning PDE solution operators across diverse equation families. However, existing multi-operator learning approaches are data-hungry and neglect physics during training. Here, we propose a physics-informed multimodal foundation model (PI-MFM) framework that directly enforces governing equations during pretraining and adaptation. PI-MFM takes symbolic representations of PDEs as the input, and automatically assembles PDE residual losses from the input expression via a vectorized derivative computation. These designs enable any PDE-encoding multimodal foundation model to be trained or adapted with unified physics-informed objectives across equation families. On a benchmark of 13 parametric one-dimensional time-dependent PDE families, PI-MFM consistently outperforms purely data-driven counterparts, especially with sparse labeled spatiotemporal points, partially observed time domains, or few labeled function pairs. Physics losses further improve robustness against noise, and simple strategies such as resampling collocation points substantially improve accuracy. We also analyze the accuracy, precision, and computational cost of automatic differentiation and finite differences for derivative computation within PI-MFM. Finally, we demonstrate zero-shot physics-informed fine-tuning to unseen PDE families: starting from a physics-informed pretrained model, adapting using only PDE residuals and initial/boundary conditions, without any labeled solution data, rapidly reduces test errors to around 1% and clearly outperforms physics-only training from scratch. These results show that PI-MFM provides a practical and scalable path toward data-efficient, transferable PDE solvers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。