arXiv:2606.04736cs.LGcs.AI2026-06

动态调整精度,让物理神经网络又快又准。

Curvature-aware dynamic precision approach for physics-informed neural networks

论文配图:Curvature-aware dynamic precision approach for physics-informed neural networks
图 1 · 摘自论文原文
  • 根据训练阶段的曲率变化自动切换单双精度
  • 在4个典型失败案例中达到或超过全双精度精度
  • 适合追求高效高精度的科学计算研究者

物理信息神经网络(PINNs)通过将物理定律嵌入训练过程,成为求解偏微分方程的有力工具。然而,近期研究表明,PINN优化对数值精度敏感:常用单精度(FP32)虽高效但易失效,双精度(FP64)虽鲁棒却代价高昂。为降低双精度训练成本同时保持精度,本文提出一种基于曲率的动态精度控制方法,不固定精度而是在训练中自适应调整。该方法利用有限内存拟牛顿法(L-BFGS)的曲率信息,判断何时用FP32、何时升级至FP64。我们在4个典型PINN失败案例及一个辐照驱动的常微分方程上测试,涵盖多种网络结构。结果表明,该方法在所有基准方程上均达到或略超全双精度精度,同时显著缩短训练时间。实验显示精度敏感性具有相位依赖性,仅在数值关键阶段使用高精度即可降低成本而不牺牲预测能力。

原文摘要 · Abstract (English)

Physics-informed neural networks (PINNs) have become a promising framework for simulating partial differential equations (PDEs) by embedding physical laws directly into neural network training. However, recent studies show that PINN optimisation is sensitive to numerical precision. Existing implementations commonly use either single precision (FP32), which is computationally efficient but prone to failure modes, or double precision (FP64), which is robust but substantially expensive. This creates a trade-off between computational efficiency and numerical accuracy. To reduce the computational cost of double-precision training while retaining prediction accuracy, we propose a curvature-aware precision controller that adapts numerical precision during training rather than treating it as a fixed implementation choice. The proposed method reuses curvature information derived from the limited-memory BFGS (L-BFGS) optimiser to construct a precision controller, retaining FP32 when lower precision is sufficient and promoting computation to FP64 when the training dynamics indicate numerical sensitivity or precision-limited stagnation. We evaluate the proposed approach on four canonical PINN failure-mode benchmarks and an irradiance-driven ordinary differential equation example. We further test the proposed approach across different neural network architectures. The method consistently matches or even slightly exceeds full FP64 solution accuracy while reducing training time relative to full double-precision training on all benchmark equations. The obtained results indicate that precision sensitivity in PINN optimisation is phase-dependent, and that selectively applying higher precision only during numerically critical stages can lower computational cost without sacrificing predictive accuracy.

PINN精度控制科学计算优化器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。