提出可自动确定秩的分层表示法,提升物理信息神经网络精度与实用性。
Hierarchical rank-evolving representation for physics-informed neural networks

- 分层设计内层小张量,结合自定义张量网络捕捉多变量函数结构
- 自动学习分解秩,无需人工调参,高维静态/动态问题均更准确
- 适合需要高精度求解复杂偏微分方程的实际工程场景
近年来,基于张量的物理信息神经网络(T-PINNs)受到越来越多关注。然而现有T-PINNs仍面临根本挑战:主要依赖预设低秩张量分解且需手动调参,限制了对多变量解函数底层结构的捕捉能力,阻碍其实际应用。为此,我们提出一种分层秩演化(HRE)表示法,可忠实捕捉目标多变量函数的内在结构,并实现自动秩确定。具体地,HRE在层次化设计中将目标函数分解为小规模内层张量,沿各模式配备一组一元函数,可灵活部署定制张量网络以捕捉内层张量的结构。其中关键超参数——秩,可在分解过程中自适应揭示,摆脱人工调参,使HRE具备实际应用潜力。此外,我们构建了对应HRE-PINNs模型。大量数值实验涵盖高维静态问题(亥姆霍兹方程、泊松方程)、非线性时变问题(克莱因-戈尔登方程)以及复杂流体动力学问题(混合流方程、纳维-斯托克斯方程),结果表明HRE-PINNs在准确性上持续优于现有最先进方法。
原文摘要 · Abstract (English)
Recently, tensor-based physics-informed neural networks (T-PINNs) have received increasing attention. However, existing T-PINNs still face a fundamental challenge: they mainly rely on pre-specified low-rank tensor decompositions with manually tuned ranks, which limits their ability to capture the underlying structures of multivariate solution functions and hinders their practical deployment. To address this challenge, we propose a hierarchical rank-evolving (abbreviated as HRE) representation for multivariate functions, which endows us to faithfully capture the underlying structure of the targeted multivariate function accompanying with automatic rank determination. Concretely, in the hierarchical design of HRE representation, the target multivariate function is decomposed as a small-scale inner tensor with a set of univariate functions along each mode, where a customized tensor network decomposition can be readily deployed to capture the underlying structure of the small-scale inner tensor. In HRE representation, the crucial hyperparameters, ranks, can be adaptively revealed during the decomposition, freeing us from manual rank tuning and making HRE practically applicable to real-world problems. Besides, we build the HRE-PINNs correspondingly. Extensive numerical experiments, including high-dimensional static problems (Helmholtz equation and Poisson equation), nonlinear time-dependent problems (Klein-Gordon equation), and complex fluid-dynamics problems (flow mixing equation and Navier-Stokes equation), demonstrate that HRE-PINNs consistently outperform existing state-of-the-art approaches in terms of accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。