arXiv:2608.25327cs.LGcs.AI2026-08

对比两种改进PINNs方法,发现需联合评估精度、架构与对齐机制。

Neither Precision Nor Architecture Alone: Controlled Tests of Failure Remedies for Physics-Informed Neural Networks

论文配图:Neither Precision Nor Architecture Alone: Controlled Tests of Failure Remedies for Physics-Informed Neural Networks
图 1 · 摘自论文原文
  • 在相同条件下测试浮点精度与状态空间模型对齐效果
  • 对流问题中仅对齐可恢复2/5种子,反应问题中架构本身已有效
  • 结果高度依赖随机种子,单一改进无法通用

物理信息神经网络(PINNs)在刚性或对流主导的偏微分方程上常失效。近期两种修复方案分别建议:从FP32切换至FP64以修复L-BFGS终止误差,或改用状态空间模型(SSM)主干并引入子序列对齐以克服架构简单性偏差。本文在预注册的144次运行中,对对流、反应和波动问题进行配对种子控制实验,并独立开展85次对流/波动研究;成功标准为相对ℓ₂误差低于0.05。结果显示,两种方法作用于不同问题域与种子组合:在高对流强度(β=50)下,对齐机制使FP32和FP64分别恢复2/5和3/5种子,而未对齐的SSM在任一精度下均失败(0/5),原生MLP仅从0/5提升至1/5。恢复效果源自对齐目标,而非骨干结构。在反应问题中,骨架本身已实现3/5–4/5种子的成功。此外,同一精度切换会使不同种子结果反向变化,在波动问题中虽降低中位误差但无显著成功率提升。独立实验表明,收紧内部L-BFGS容忍度虽降低中位误差,但代价巨大且成功率不变。因此,精度、终止条件、架构与对齐必须联合评估,并按种子报告结果。

原文摘要 · Abstract (English)

Physics-Informed Neural Networks (PINNs) frequently fail on stiff or advection-dominated PDEs, and two recent accounts offer competing remedies: switching from FP32 to FP64 to repair an L-BFGS stopping artifact, or replacing the MLP with a state-space-model (SSM) backbone plus sub-sequence alignment to counter architectural simplicity bias. We test both under matched, seed-paired controls in a pre-registered 144-run study spanning convection, reaction, and wave, plus an independent 85-run convection/wave study; success is relative $\ell_2$ error below $0.05$. The two remedies act on disjoint regime-and-seed slices: neither substitutes for the other. On hard convection ($β{=}50$), alignment recovers 2/5 seeds in FP32 and 3/5 in FP64, where the unaligned SSM succeeds on 0/5 seeds at either precision and the vanilla MLP moves only from 0/5 to 1/5 across the precision switch---the recoveries trace to the alignment objective, not the backbone. On reaction the backbone alone already succeeds on 3/5--4/5 seeds, so each remedy covers a regime the other does not. Responses are also seed-specific: the same precision switch flips individual seeds in opposite directions and, on wave, lowers median error with no statistically significant success gain. Tightening the inner L-BFGS tolerance in an independent repeated-step runner likewise lowers median error at a large runtime cost, with success counts unchanged. Precision, stopping, backbone, and alignment must therefore be evaluated jointly and reported per seed.

PINNsPDE求解数值稳定性实验可复现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。