arXiv:2506.23024cs.LGcs.AI2025-06被引 2

用重心插值层突破PINN精度瓶颈,揭示精度与条件数的权衡

BWLer: Barycentric Weight Layer Elucidates a Precision-Conditioning Tradeoff for PINNs

  • 引入重心权重层(BWLer)实现解空间的高精度插值表示
  • 在1维插值任务中,纯MLP精度止步于1e-8 RMSE,而加BWLer后提升至10亿倍
  • 适合追求高精度科学计算的物理信息神经网络研究者

物理信息神经网络(PINNs)为求解偏微分方程(PDEs)提供了灵活的机器学习方法,但仍远未达到科学任务所需的机器精度。本文探究精度上限是否源于PDE本身的病态性或传统多层感知机(MLP)架构的局限。提出重心权重层(BWLer),通过重心多项式插值建模PDE解。BWLer可叠加于现有MLP之上(BWLer-hat)或完全替代之(显式BWLer),清晰分离解的表示与导数计算。实验发现:即使参数量达1e5的MLP,在无PDE项时也仅能收敛至约1e-8 RMSE,比浮点双精度低八数量级。引入BWLer后突破此极限,并揭示了精度与PDE损失条件数间的权衡。对线性PDE,通过谱导数与预处理实现了误差的显式分解与训练优化。在五个基准PDE上,叠加BWLer使对流、反应、波动方程的RMSE分别提升30倍、10倍、1800倍,且兼容一阶优化器;完全替换MLP的显式BWLer在对流、反应和波动问题上达到接近机器精度(较之前结果提升最高达100亿倍),并在刚性Burgers和非规则几何泊松问题上匹配标准PINN表现。这些结果指明了将PINN灵活性与经典谱求解器精度结合的可行路径。

原文摘要 · Abstract (English)

Physics-informed neural networks (PINNs) offer a flexible way to solve partial differential equations (PDEs) with machine learning, yet they still fall well short of the machine-precision accuracy many scientific tasks demand. In this work, we investigate whether the precision ceiling comes from the ill-conditioning of the PDEs or from the typical multi-layer perceptron (MLP) architecture. We introduce the Barycentric Weight Layer (BWLer), which models the PDE solution through barycentric polynomial interpolation. A BWLer can be added on top of an existing MLP (a BWLer-hat) or replace it completely (explicit BWLer), cleanly separating how we represent the solution from how we take derivatives for the PDE loss. Using BWLer, we identify fundamental precision limitations within the MLP: on a simple 1-D interpolation task, even MLPs with O(1e5) parameters stall around 1e-8 RMSE -- about eight orders above float64 machine precision -- before any PDE terms are added. In PDE learning, adding a BWLer lifts this ceiling and exposes a tradeoff between achievable accuracy and the conditioning of the PDE loss. For linear PDEs we fully characterize this tradeoff with an explicit error decomposition and navigate it during training with spectral derivatives and preconditioning. Across five benchmark PDEs, adding a BWLer on top of an MLP improves RMSE by up to 30x for convection, 10x for reaction, and 1800x for wave equations while remaining compatible with first-order optimizers. Replacing the MLP entirely lets an explicit BWLer reach near-machine-precision on convection, reaction, and wave problems (up to 10 billion times better than prior results) and match the performance of standard PINNs on stiff Burgers' and irregular-geometry Poisson problems. Together, these findings point to a practical path for combining the flexibility of PINNs with the precision of classical spectral solvers.

PINN高精度插值数值方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。