arXiv:2411.19125cs.LG2024-11被引 9

用隐空间建模让物理神经网络更好泛化于不同方程

Advancing Generalization in PINNs through Latent-Space Representations

  • 将PDE解投影到隐空间,学习系数相关的动态规律
  • 在1D和2D方程上实现更稳定的训练与更远时间外推
  • 适合需要跨场景泛化的科学计算与逆问题研究者

物理信息神经网络(PINNs)在求解偏微分方程(PDE)驱动的动力系统方面取得显著进展,但其在不同场景下的泛化能力仍受限。为此,我们提出PIDO,一种新型物理信息神经PDE求解器,可有效泛化至不同PDE配置,包括变化的初值、方程系数及训练时间范围。PIDO通过自编码机制将PDE解投影至隐空间,并学习该隐表示的动态,条件依赖于方程系数。尽管如此,将隐空间动力学模型融入物理信息框架面临优化困难。为此,我们提出一种新方法,在隐空间内诊断并缓解这些问题,采用简单有效的正则化策略,显著提升时间外推性能与训练稳定性。我们在一系列基准任务上验证了PIDO,涵盖1D耦合方程与2D纳维-斯托克斯方程。此外,我们展示了其学习表示在长期积分与反问题等下游任务中的可迁移性。

原文摘要 · Abstract (English)

Physics-informed neural networks (PINNs) have made significant strides in modeling dynamical systems governed by partial differential equations (PDEs). However, their generalization capabilities across varying scenarios remain limited. To overcome this limitation, we propose PIDO, a novel physics-informed neural PDE solver designed to generalize effectively across diverse PDE configurations, including varying initial conditions, PDE coefficients, and training time horizons. PIDO exploits the shared underlying structure of dynamical systems with different properties by projecting PDE solutions into a latent space using auto-decoding. It then learns the dynamics of these latent representations, conditioned on the PDE coefficients. Despite its promise, integrating latent dynamics models within a physics-informed framework poses challenges due to the optimization difficulties associated with physics-informed losses. To address these challenges, we introduce a novel approach that diagnoses and mitigates these issues within the latent space. This strategy employs straightforward yet effective regularization techniques, enhancing both the temporal extrapolation performance and the training stability of PIDO. We validate PIDO on a range of benchmarks, including 1D combined equations and 2D Navier-Stokes equations. Additionally, we demonstrate the transferability of its learned representations to downstream applications such as long-term integration and inverse problems.

PINN隐空间泛化方程求解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。