arXiv:2410.22796cs.LGcs.CE2024-10ICLR被引 3

用约束学习框架解决微分方程,免调参且更准更快。

Solving Differential Equations with Constrained Learning

  • 将微分方程求解转化为最坏情况损失的约束学习问题。
  • 在多种方程和模型上实现高精度解,无需精细调参。
  • 适合需要快速泛化、融合物理先验的科学计算场景。

偏微分方程(PDE)是描述自然现象的基本工具,其求解在科学与工程中至关重要。传统方法如有限元法依赖计算量大的细网格,难以融入观测数据或已有解,参数变化时需重新计算。基于神经网络的方法(如物理信息神经网络、神经算子)提供无网格方案,可融合先验知识并处理整类PDE,但对采样点和损失权重等超参数极为敏感。本文提出科学约束学习(SCL)框架,证明求解PDE的弱解等价于最小化最坏情况损失的约束学习问题,解释了以往方法仅优化平均损失的局限性。SCL自然整合结构约束(如不变性)和部分测量值或已知解。所提算法在多种PDE、神经网络架构及先验水平下均获得高精度解,且无需复杂调参,有时计算成本更低。

原文摘要 · Abstract (English)

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable solutions, their accuracy is often tied to the use of computationally intensive fine meshes. Moreover, they do not naturally account for measurements or prior solutions, and any change in the problem parameters requires results to be fully recomputed. Neural network-based approaches, such as physics-informed neural networks and neural operators, offer a mesh-free alternative by directly fitting those models to the PDE solution. They can also integrate prior knowledge and tackle entire families of PDEs by simply aggregating additional training losses. Nevertheless, they are highly sensitive to hyperparameters such as collocation points and the weights associated with each loss. This paper addresses these challenges by developing a science-constrained learning (SCL) framework. It demonstrates that finding a (weak) solution of a PDE is equivalent to solving a constrained learning problem with worst-case losses. This explains the limitations of previous methods that minimize the expected value of aggregated losses. SCL also organically integrates structural constraints (e.g., invariances) and (partial) measurements or known solutions. The resulting constrained learning problems can be tackled using a practical algorithm that yields accurate solutions across a variety of PDEs, neural network architectures, and prior knowledge levels without extensive hyperparameter tuning and sometimes even at a lower computational cost.

微分方程神经网络约束学习科学计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。